-- Logs begin at Thu 2022-06-02 12:55:25 UTC, end at Thu 2022-06-02 13:57:39 UTC. -- Jun 02 13:27:27.940603 dv-cinder-836083-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 13:27:27.949299 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 13:27:27.951286 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:27:27 2022] *** Jun 02 13:27:27.951286 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:27:27.951286 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:27:27.951286 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: nodename: dv-cinder-836083-8-iscsi Jun 02 13:27:27.951286 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: machine: x86_64 Jun 02 13:27:27.951286 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: clock source: unix Jun 02 13:27:27.951286 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: pcre jit disabled Jun 02 13:27:27.951286 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: detected number of CPU cores: 4 Jun 02 13:27:27.951286 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: current working directory: / Jun 02 13:27:27.951286 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:27:27.951939 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: your processes number limit is 47680 Jun 02 13:27:27.951939 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: your memory page size is 4096 bytes Jun 02 13:27:27.951939 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: detected max file descriptor number: 2048 Jun 02 13:27:27.951939 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: lock engine: pthread robust mutexes Jun 02 13:27:27.951939 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: thunder lock: enabled Jun 02 13:27:27.951939 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 13:27:27.951939 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:27:27.996565 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: Python main interpreter initialized at 0x56430640d9c0 Jun 02 13:27:27.996565 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: python threads support enabled Jun 02 13:27:27.996565 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: your server socket listen backlog is limited to 100 connections Jun 02 13:27:27.996565 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:27:27.996880 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:27:27.996961 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: *** Operational MODE: preforking *** Jun 02 13:27:27.997224 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:27:27.997224 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: spawned uWSGI master process (pid: 103267) Jun 02 13:27:27.997399 dv-cinder-836083-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 13:27:27.998006 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: spawned uWSGI worker 1 (pid: 103268, cores: 1) Jun 02 13:27:28.000335 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: spawned uWSGI worker 2 (pid: 103269, cores: 1) Jun 02 13:27:28.000335 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:27:29.212637 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:27:29.225509 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:27:29.925134 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:27:29.925134 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: from cryptography.utils import int_from_bytes Jun 02 13:27:29.925452 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:27:29.925452 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: from cryptography.utils import int_from_bytes Jun 02 13:27:29.927953 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:27:29.927953 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: from cryptography.utils import int_from_bytes Jun 02 13:27:29.928287 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:27:29.928287 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: from cryptography.utils import int_from_bytes Jun 02 13:27:32.473922 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:27:32.474500 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:27:32.474676 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:27:32.475032 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:27:32.475286 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:27:32.475667 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.475990 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.476328 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.476646 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.476974 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.477080 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:27:32.477451 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.477541 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:27:32.477635 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.477822 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:27:32.477918 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.478188 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:27:32.478293 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.478440 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.478555 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:27:32.478750 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.478845 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.479071 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-8-iscsi {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.479167 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.479388 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.479481 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.479690 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.479785 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.479997 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.480097 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.480321 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.480423 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.480633 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.480730 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.480948 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.481043 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.481249 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.481344 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.481583 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.481736 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.481903 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.482169 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.482291 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-8-iscsi {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.482473 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.482641 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.482764 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.482879 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.483093 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.483210 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.483401 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.483571 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.483715 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.483866 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.484032 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.484139 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.484353 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.484459 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.484678 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.484860 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.484972 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.485177 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.485358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-8-iscsi {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.485487 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.485672 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.485800 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.485982 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.486138 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.486283 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.486458 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.486684 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.486779 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.486993 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.487094 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.487294 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.487396 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.487607 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.487697 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.487926 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.488021 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.488230 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.488418 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-8-iscsi {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.488577 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.488746 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.488972 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.489074 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.489288 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.489388 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.489603 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.489775 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.489899 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.490090 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.490190 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.490406 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.490502 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.490733 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.490822 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.491060 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.491151 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.491364 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.491451 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.491611 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.491706 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.491912 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.492003 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.492229 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.492344 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.492572 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.492680 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.492889 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.492989 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.493136 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.493231 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.493381 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.493521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.493697 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.493846 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.494013 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.494157 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.494316 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.494466 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.494618 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.494713 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.494917 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.495012 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.495216 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.495329 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.495517 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.495653 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.495817 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.495979 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.496115 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.496236 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.496440 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.496530 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.496753 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.496858 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.497064 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.497173 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.497382 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.497491 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.497683 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.497790 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.497994 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.498099 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.498309 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.498432 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.498614 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.498711 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.498916 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.499007 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.499221 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.499323 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.499536 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.499634 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.499834 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.499925 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.500145 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.500249 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.500484 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.500577 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.500786 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.500875 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.501086 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.501180 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.501386 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.501483 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.501698 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.501793 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.502013 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.502112 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.502296 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.502392 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.502540 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.502655 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.502835 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.502968 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.503136 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.503290 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.503445 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.503615 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.503750 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.503994 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.504102 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.504759 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.504858 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.505077 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.505173 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.505403 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.505493 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.505722 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.505816 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.506022 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.506111 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.506273 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.506361 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.506579 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.506674 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.506888 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.506986 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.507187 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.507294 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.507484 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.507575 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.507783 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.507881 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.508108 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.508201 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.508418 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.508540 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.508718 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.508822 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.509018 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.509113 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.509316 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.509484 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.509617 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.509719 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.509924 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.510011 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.510221 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.510356 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.510520 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.510618 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.510825 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.510919 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.511120 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.511208 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.511417 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.511517 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.511727 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.511822 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.512029 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.512118 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.512347 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.512442 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.512657 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.512756 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.512949 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.513043 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.513248 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.513350 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.513557 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.513647 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.513857 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.513951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.514159 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.514249 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.514455 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.514550 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.514751 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.514840 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.515048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.515143 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.515345 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.515434 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.515641 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.515729 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.515936 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.516026 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.516228 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.516331 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.516563 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.516667 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.516877 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.516973 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.517179 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.517324 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.517479 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.517570 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.517777 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.517867 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.518079 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.518173 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.518387 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.518484 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.518694 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.518783 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.519001 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.519089 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.519307 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.519410 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.519611 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.519701 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.520521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.520669 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.520841 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.520945 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.521158 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.521246 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.521469 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.521558 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.521779 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.521883 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.522094 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.522181 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:27:32.522401 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.522496 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.522707 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.522805 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.523020 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.523109 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.523334 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.523421 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.523657 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.523747 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.523966 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.524055 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.524285 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.524436 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.524617 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.524706 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.524924 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.525020 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.525237 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.525340 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.525559 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.525650 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.525872 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.525970 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.526177 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.526271 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.526497 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.526593 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.526819 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.526909 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.527126 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.527226 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.527444 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.527541 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.527760 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.527849 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.528064 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.528163 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.528397 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.528509 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.528702 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.528797 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.529019 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.529119 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.529341 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.529429 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.529645 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.529743 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.529960 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.530058 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.530266 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.530363 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.530573 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.530668 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.530875 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.530977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.531181 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.531271 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.531487 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.531583 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.531817 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.531907 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.532128 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.532219 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.532463 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.532553 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.532771 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.532862 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.533085 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.533173 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.533392 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.533480 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.533699 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.533789 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.534006 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.534096 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.534312 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.534415 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.534614 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.534712 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.534914 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.535003 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.535218 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.535319 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.535556 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.535652 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.535879 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.535967 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.536191 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.536286 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.536521 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.536610 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.536840 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.536933 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.537140 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.537241 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.537448 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.537583 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.537753 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.537849 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.538055 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.538151 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.538357 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.538452 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.538666 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.538760 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.538969 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.539064 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.539270 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.539366 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.539589 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.539679 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.539894 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.539988 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.540196 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.540292 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.540540 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.540631 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.540842 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.540940 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.541142 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.541239 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.541450 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.541546 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.541753 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.541842 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.542059 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.542155 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.542365 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.542462 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.542671 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.542759 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.542983 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.543078 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.543292 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.543389 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.543597 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.543684 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.543923 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.544012 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.544233 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.544353 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.544564 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.544659 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.544878 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.544965 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.545192 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.545289 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.545500 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.545587 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.545801 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.545891 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.546105 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.546203 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.546405 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.546500 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.546707 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.546804 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.547005 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.547103 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.547307 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.547396 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.547603 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.547691 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.547902 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.547992 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.548196 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.548285 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.548519 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.548616 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.548820 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.548910 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.549137 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.549226 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.549441 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.549537 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.549738 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.549827 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.550039 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.550135 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.550337 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.550435 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.550671 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.550765 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.550972 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.551067 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.551302 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.551399 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.551609 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.551705 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.551916 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.552004 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.552223 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.552347 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.552567 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.552675 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.552876 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.552963 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.553179 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.553275 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.553483 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.553571 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.553785 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.553873 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.554094 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.554192 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.554413 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.554552 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.554719 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.554809 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.555032 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.555157 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.555339 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.555429 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.555657 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.555746 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.555961 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.556050 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.556275 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.556383 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.556598 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.556696 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.556907 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.556995 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.557217 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.557305 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.557534 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.557632 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.557848 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.557937 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.558157 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.558244 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.558459 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.558556 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.558768 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.558857 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.559071 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.559201 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.559374 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.559586 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.559674 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.559764 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.559969 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.560059 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.560280 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.560436 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.560606 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.560703 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.560915 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.561032 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.561216 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.561352 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.561532 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.561675 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.561837 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.561990 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.562148 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.562307 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.562444 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.562619 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.562750 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.562933 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.563068 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.563246 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.563391 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.563559 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.563694 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.563880 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.564001 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.564193 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.564335 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.564537 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.564670 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.564850 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.564942 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.565174 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.565306 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.565484 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.565582 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.565791 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.565880 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.566094 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.566182 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.566398 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.566492 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.566702 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.567280 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.567516 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.567616 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.567818 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.567907 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.568126 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.568216 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.568451 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.568543 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.568750 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.568852 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.569047 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.569135 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.569350 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.569442 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.569663 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.569760 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.569967 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.570064 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.570276 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.570365 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.570588 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.570683 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.570887 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.570976 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.571182 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.571271 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.571489 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.571587 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.571787 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.571874 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.572088 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.572179 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.572411 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.572504 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.572714 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.572804 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.573025 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.573112 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.573340 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.573428 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.573641 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.573729 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.573948 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.574045 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.574261 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.574352 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.574563 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.574650 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.574870 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.574958 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.575173 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.575269 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.575477 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.575572 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.575782 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.575869 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.576085 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.576173 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.576409 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.576499 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.576716 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.576816 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.577019 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.577106 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.577321 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.577418 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.577624 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.577726 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.577939 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.578037 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.578240 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.578329 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.578546 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.578643 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.578849 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.578937 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.579148 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.579237 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.579453 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.579545 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.579761 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.579849 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.580069 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.580331 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.580437 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.580663 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.580751 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.580970 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.581066 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.581280 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.581377 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.581591 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.581688 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.581902 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.581991 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.582211 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.582306 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.583060 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.583160 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.583369 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.583466 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.583681 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.583778 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.583985 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.584076 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.584283 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.584568 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.584660 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.584905 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.585002 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.585204 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.585294 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.585502 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.585592 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.585799 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.585890 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.586102 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.586442 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.586655 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.586747 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.586952 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.587044 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.587248 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.587338 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.587544 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.587643 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.587849 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.587952 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.588145 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.588234 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.588478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.588583 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.588777 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.588879 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.589092 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.589198 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.589395 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.589483 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.589691 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.589790 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.589988 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.590077 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.590286 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.590374 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.590594 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.590691 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.590901 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.591000 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.591207 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.591296 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.591521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.591612 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.591826 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.591917 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.592132 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.592219 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.592457 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.592547 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.592773 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.592872 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.593071 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.593160 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.593369 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.593459 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.593665 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.593754 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.593966 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.594066 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.594263 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.594359 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.594559 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.594648 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.594868 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.594965 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.595171 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.595261 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.595472 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.595607 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.595773 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.595872 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.596066 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.596156 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.596389 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.596494 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.596687 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.596785 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.596995 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.597085 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.597295 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.597383 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.597593 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.597683 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.597890 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.597997 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.598217 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.598307 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.598519 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.598609 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.598814 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.598910 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.599117 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.599212 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.599413 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.599503 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.599720 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.599806 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.600012 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.600106 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.600338 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.600432 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.600632 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.600720 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.600934 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.601036 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.601233 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.601321 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.601526 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.601621 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.601831 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.601931 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.602129 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.602217 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.602426 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.602515 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.602721 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.602818 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.603020 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.603107 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.603314 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.603404 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.603609 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.603716 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.603908 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.603996 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.604208 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.604314 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.604541 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.604631 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.604844 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.604932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.605145 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.605233 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.605438 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.605535 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.605737 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.605826 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.606032 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.606121 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.606332 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.606422 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.606627 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.606715 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.606922 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.607012 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.607216 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.607306 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.607512 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.607608 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.607807 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.607906 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.608120 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.608257 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.608442 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.608545 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.608740 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.608849 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.609039 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.609128 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.609334 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.609423 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.609637 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.609733 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.609950 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.610047 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.610258 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.610354 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.610571 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.610673 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.610876 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.610964 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.611180 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.611267 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.611481 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.611578 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.611787 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.611875 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.612092 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.612180 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.612413 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.612507 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.612722 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.612810 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.613023 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.613119 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.613328 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.613419 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.613647 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.613739 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.613947 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.614037 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.614262 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.614360 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.614566 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.614655 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.614877 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.614979 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.615193 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.615290 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.615507 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.615597 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.615817 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.615917 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.616114 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.616202 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.616452 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.616542 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.616756 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.616856 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.617057 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.617146 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.617359 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.617446 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.617657 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.617753 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.617961 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.618050 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.618266 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.618409 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.618571 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.618670 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.618875 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.618965 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.619179 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.619267 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.619478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.619568 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.619778 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.619866 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.620078 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.620167 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.620399 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.620492 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.620719 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.620807 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.621021 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.621109 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.621317 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.621408 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.621618 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.621742 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.621913 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.622002 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.622215 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.622305 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.622512 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.622600 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.622821 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.622917 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.623131 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.623228 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.623444 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.623534 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.623755 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.623853 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.624062 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.624151 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.624421 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.624513 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.624734 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.624836 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.625043 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.625134 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.625352 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.625440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.625655 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.625751 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.625967 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.626057 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.626273 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.626362 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.626639 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.626729 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.626938 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.627028 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.627235 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.627331 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.627538 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.627629 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.627853 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.627941 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.628151 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.628248 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.628475 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.628567 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.628772 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.628861 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.629087 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.629175 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.629898 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.630026 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.630214 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.630348 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.630622 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.630720 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.630927 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.631016 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.631225 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.631321 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.631558 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.631653 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.631874 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.631964 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.632202 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.632315 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.632537 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.632639 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.632845 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.632936 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.633153 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.633241 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.633448 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.633547 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.633756 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.633846 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.634058 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.634154 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.634374 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.634472 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.634691 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.634779 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.634996 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.635085 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.635309 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.635479 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.635608 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.635793 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.635923 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.636105 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.636237 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.636455 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.636558 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.636782 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.636879 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.637109 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.637260 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.637418 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.637576 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.637733 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.637882 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.638042 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.638199 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.638367 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.638517 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.638694 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.638817 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.639009 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.639119 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.639325 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.639424 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.639633 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.639722 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.639957 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.640046 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.640280 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.640388 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.640605 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.640694 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.640912 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.641003 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.641217 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.641343 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.641518 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.641670 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.641819 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.641985 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.642118 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.642312 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.642431 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.642640 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.642731 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.642951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.643041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.643258 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.643359 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.643570 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.643659 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.643879 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.644008 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.644189 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.644279 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.644540 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.644630 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.644858 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.644950 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.645192 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.645281 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.645495 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.645583 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.645795 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.645886 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.646101 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.646188 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.646410 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.646512 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.646722 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.646811 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.647027 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.647116 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.647352 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.647486 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.647656 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.647746 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.647977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.648066 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.648292 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.648419 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.648624 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.648714 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.648932 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.649019 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.649243 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.649340 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.649540 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.649626 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.649835 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.649926 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.650137 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.650225 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.650432 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.650527 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.650732 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.650823 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.651030 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.651121 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.651332 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.651420 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.651628 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.651716 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.651924 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.652017 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.652221 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.652351 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.652569 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.652668 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.652870 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.652989 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.653185 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.653310 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.653487 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.653636 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.653784 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.653944 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.654083 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.654250 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.654380 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.654562 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.654714 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.654870 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.655013 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.655178 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.655343 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.655483 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.655656 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.655790 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.655971 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.656096 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.656293 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.656495 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.656621 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.656790 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.656939 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.657114 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.657252 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.657421 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.657561 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.657743 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.657872 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.658054 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.658181 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.658361 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.658491 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.658669 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.658799 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.658975 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.659140 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.659318 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.659408 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.659624 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.659713 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.659958 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.660057 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.660277 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.660431 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.661155 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.661376 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.661479 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.661705 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.661796 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.662019 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.662116 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.662329 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.662426 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.662640 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.662730 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.662954 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.663042 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.663264 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.663363 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.663573 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.663663 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.663882 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.663972 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.664189 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.664287 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.664522 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.664613 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.664840 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.664928 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.665155 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.665245 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.665473 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.665561 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.665807 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.665996 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.666122 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.666330 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.666420 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.666648 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.666739 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.666966 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.667127 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.667285 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.667375 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.667604 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.667695 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.667923 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.668015 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.668239 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.668357 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.668574 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.668671 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.668885 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.668975 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.669187 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.669276 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.669494 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.669592 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.669804 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.669893 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.670112 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.670208 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.670418 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.670520 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.670723 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.670813 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.671032 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.671129 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.671342 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.671446 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.671660 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.671750 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.671988 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.672077 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.672319 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.672413 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.672634 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.672724 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.672944 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.673033 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.673253 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.673345 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.673578 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.673765 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.673896 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.674072 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.674213 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.674397 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.674533 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.674718 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.674852 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.675037 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.675167 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.675348 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.675481 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.675665 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.675798 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.675986 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.676145 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.676846 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.676992 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.677150 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.677330 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.677458 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.677656 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.677763 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.677976 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.678055 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.678295 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.678386 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.678615 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.678706 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.678940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.679138 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.679241 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.679457 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.679548 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.679794 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.680054 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.680146 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.680414 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.680519 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.680729 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.680817 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.681049 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.681138 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.681368 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.681466 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.681682 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.681771 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.681984 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.682081 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.682295 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.682410 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.682593 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.682682 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.682893 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.682992 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.683202 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.683296 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.683506 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.683603 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.683803 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.683902 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.684102 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.684192 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.684428 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.684519 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.684735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.684980 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.685072 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.685323 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.685419 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.685621 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.685719 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.685946 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.686038 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.686245 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.686341 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.686542 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.686640 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.686841 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.686931 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.687146 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.687235 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.687446 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.687545 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.687744 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.687835 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.688043 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.688139 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.688362 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.688506 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.688670 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.688786 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.688967 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.689092 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.689696 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.689696 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.690333 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.690414 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.690505 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.690590 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.690680 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.690861 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.690953 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.691164 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.691253 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.691471 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.691569 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.691800 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.691891 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.692117 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.692205 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.692463 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.692570 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.692761 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.692850 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.693069 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.693165 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.693371 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.693460 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.693684 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.693772 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.693989 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.694076 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.694295 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.694385 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.694599 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.694686 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.694914 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.695003 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.695223 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.695444 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.695535 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.695776 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.695869 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.696095 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.696193 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.696453 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.696557 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.696783 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.696873 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.697089 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.697181 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.697391 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.697481 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.697691 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.697780 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.698009 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.698100 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.698313 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.698412 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.698617 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.698714 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.698922 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.699014 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.699225 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.699478 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.699569 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.699815 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.699905 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.700116 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.700205 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.700443 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.700535 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.700747 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.700839 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.701049 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.701139 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.701351 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.701439 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.701653 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.701750 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.701956 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.702045 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.702262 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.702350 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.702595 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.702687 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.702906 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.702993 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.703214 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.703310 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.703523 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.703610 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.703831 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.703919 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.704136 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.704353 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.704454 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.704538 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.704754 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.704845 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.705057 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.705218 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.705366 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.705463 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.705677 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.705768 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.705984 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.706081 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.706285 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.706375 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.706624 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.706712 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.706948 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.707039 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.707269 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.707378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.707615 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.707704 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.707917 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.708046 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.708231 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.708347 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.708566 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.708669 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.708869 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.708958 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.709177 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.709264 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.709478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.709579 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.709802 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.709891 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.710114 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.710201 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.710421 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.710521 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.710748 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.710844 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.711051 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.711384 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.711603 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.711702 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.711903 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.711999 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.712205 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.712315 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.712544 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.712644 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.712850 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.712940 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.713149 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.713238 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.713446 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.713567 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.713749 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.713883 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.714045 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.714214 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.714344 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.714553 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.714642 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.714884 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.714974 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.715208 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.715296 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.715503 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.715592 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.715798 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.715887 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.716094 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.716184 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.716417 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.716510 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.716714 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.716804 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.717012 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.717104 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.717313 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.717405 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.717609 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.717707 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.717909 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.717998 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.718207 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.718296 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.718502 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.718600 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.718797 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.718895 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.719098 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.719185 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.719408 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.719506 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.719712 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.719803 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.720018 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.720107 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.720339 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.720444 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.720649 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.720739 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.720948 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.721038 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.721250 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.721339 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.721558 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.721647 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.721861 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.721957 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.722160 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.722249 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.722463 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.722550 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.722766 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.722854 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.723576 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.723676 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.723884 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.724014 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.724189 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.724282 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.724519 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.724611 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.724822 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.724913 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.725143 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.725241 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.725463 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.725552 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.725766 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.725854 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.726084 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.726245 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.726398 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.726487 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.726710 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.726797 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.727016 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.727113 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.727322 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.727422 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.727642 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.727730 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.727944 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.728033 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.728249 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.728356 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.728582 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.728672 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.728886 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.728974 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.729191 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.729289 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.729502 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.729591 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.729811 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.729901 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.730122 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.730217 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.730438 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.730526 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.730742 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.730832 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.731062 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.731160 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.731376 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.731474 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.731690 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.731786 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.732004 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.732099 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.732354 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.732460 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.732652 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.732742 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.732969 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.733066 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.733275 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.733376 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.733576 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.733666 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.733814 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:27:32.733903 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.734191 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.734517 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.734843 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.735155 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.735483 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.735809 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.736155 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.736492 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.736838 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.737168 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.737485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.737800 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.738108 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:27:32.738352 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:27:32.792186 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Registered counter for database nova_api Jun 02 13:27:32.797439 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Registered counter for database nova_api Jun 02 13:27:32.811746 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:27:32.816900 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:27:32.818271 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:27:32.824069 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:27:32.874711 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.context [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),309ea19d-aef7-4c6c-9f87-a5fdcea29505(cell1) {{(pid=103268) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:27:32.878803 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:32.880373 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.context [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),309ea19d-aef7-4c6c-9f87-a5fdcea29505(cell1) {{(pid=103269) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:27:32.880498 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:32.881202 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:32.883107 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:32.884456 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:32.885088 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Registered counter for database nova_cell0 Jun 02 13:27:32.886045 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:32.886839 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:27:32.888825 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:27:32.889027 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Registered counter for database nova_cell1 Jun 02 13:27:32.890784 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Registered counter for database nova_cell0 Jun 02 13:27:32.895861 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Registered counter for database nova_cell1 Jun 02 13:27:32.896604 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:27:32.899071 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:27:32.902899 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:27:32.903278 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:27:32.904896 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:27:32.910427 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:27:32.916181 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:27:33.040443 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:27:33.050268 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Registered counter for database nova_cell0 Jun 02 13:27:33.059123 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:27:33.063535 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:27:33.067518 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Registered counter for database nova_cell0 Jun 02 13:27:33.076353 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:27:33.080647 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:27:33.520909 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:27:33.521656 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:27:33.528228 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:27:33.528981 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:27:33.748652 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:27:33.752420 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:27:33.754617 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:27:33.758375 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:27:33.759700 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56430640d9c0 pid: 103268 (default app) Jun 02 13:27:33.762824 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:27:33.763454 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56430640d9c0 pid: 103269 (default app) Jun 02 13:27:33.764010 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-b5f4b887-20a0-459e-b87f-15c003586f82 None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002743 Jun 02 13:27:33.764451 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 788 bytes} [Thu Jun 2 13:27:33 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:51.760135 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:51.761373 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Jun 02 13:28:51.761761 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:51.774104 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=3 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:51.775247 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell1:SELECT=3 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:51.776493 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell0:SELECT=3 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:51.777435 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:52.222672 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-84bd7661-154b-458a-814f-55fd837a6ff4 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:52.254919 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-84bd7661-154b-458a-814f-55fd837a6ff4 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.486103 Jun 02 13:28:52.260383 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 2/3] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Jun 2 13:28:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:54.549880 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:54.550905 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-ed86b673-31bf-464a-9dd6-e498eb8930ad None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 02 13:28:54.551455 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 2/4] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:54.618311 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-59190ef0-d7b4-4837-b517-ac53a40c1591 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:54.636680 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:28:54.636680 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: warnings.warn(msg) Jun 02 13:28:54.666857 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-59190ef0-d7b4-4837-b517-ac53a40c1591 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109494 Jun 02 13:28:54.667613 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 3/5] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Jun 2 13:28:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:54.680773 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=3 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:54.681973 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell0:SELECT=3 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:54.682741 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell1:SELECT=3 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:54.684000 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell0:SELECT=3 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:28:54.888676 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-4b57c897-5470-4b70-8b85-05d26f3cd727 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:54.891108 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:28:54.891108 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 02 13:28:54.956796 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-4b57c897-5470-4b70-8b85-05d26f3cd727 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281054 Jun 02 13:28:54.957596 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 3/6] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Jun 2 13:28:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:28:57.268575 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-59190ef0-d7b4-4837-b517-ac53a40c1591 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:57.269517 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-59190ef0-d7b4-4837-b517-ac53a40c1591 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jun 02 13:28:57.269917 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 4/7] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:57.375197 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-0a6f0146-7c1d-4c8e-aade-279e82f2f3d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "id": "d1", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:57.392541 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:28:57.392541 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 02 13:28:57.410827 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-0a6f0146-7c1d-4c8e-aade-279e82f2f3d6 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135179 Jun 02 13:28:57.411401 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 4/8] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Jun 2 13:28:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:28:57.423161 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-bf48bb8a-c9b3-4244-b4cf-dcdbd11ae433 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:57.424778 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:28:57.424778 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: warnings.warn(msg) Jun 02 13:28:57.457569 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-bf48bb8a-c9b3-4244-b4cf-dcdbd11ae433 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038062 Jun 02 13:28:57.458140 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 5/9] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Jun 2 13:28:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:28:59.769434 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-0a6f0146-7c1d-4c8e-aade-279e82f2f3d6 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:28:59.770439 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-0a6f0146-7c1d-4c8e-aade-279e82f2f3d6 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 02 13:28:59.770840 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:28:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:28:59.832250 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-f623b7f8-bffa-4dc8-929f-cf1197b539e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:59.852053 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-f623b7f8-bffa-4dc8-929f-cf1197b539e3 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075207 Jun 02 13:28:59.852546 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 6/11] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Jun 2 13:28:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:28:59.865347 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-763f8b89-a42c-4ddd-bb5f-6f97e1a1314f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:28:59.888728 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-763f8b89-a42c-4ddd-bb5f-6f97e1a1314f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027820 Jun 02 13:28:59.889416 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 6/12] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Jun 2 13:28:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:02.238664 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-f623b7f8-bffa-4dc8-929f-cf1197b539e3 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:02.239687 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-f623b7f8-bffa-4dc8-929f-cf1197b539e3 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 02 13:29:02.240106 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 7/13] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:29:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:02.304115 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-863f0a6a-4a3e-4bf1-ac56-28d0e784ac13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:02.323443 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-863f0a6a-4a3e-4bf1-ac56-28d0e784ac13 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076525 Jun 02 13:29:02.324165 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 7/14] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Jun 2 13:29:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:02.337504 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-641ab915-9077-4c7c-b04f-05f86ee6fa81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:02.361256 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-641ab915-9077-4c7c-b04f-05f86ee6fa81 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027847 Jun 02 13:29:02.361852 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 8/15] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Jun 2 13:29:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:29:04.665391 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-863f0a6a-4a3e-4bf1-ac56-28d0e784ac13 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:04.666403 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-863f0a6a-4a3e-4bf1-ac56-28d0e784ac13 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 02 13:29:04.666813 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 8/16] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:04.726521 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-00f44d52-4aa2-4c6d-8868-6e59739cbd3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "vcpus": 4}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:04.756259 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-00f44d52-4aa2-4c6d-8868-6e59739cbd3d admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083639 Jun 02 13:29:04.757212 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 9/17] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Jun 2 13:29:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:04.770154 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-3544dac1-cd6b-4724-b361-c034816749f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:04.794507 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-3544dac1-cd6b-4724-b361-c034816749f5 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028724 Jun 02 13:29:04.795236 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 9/18] 10.222.0.32 () {64 vars in 1335 bytes} [Thu Jun 2 13:29:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:07.082960 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-00f44d52-4aa2-4c6d-8868-6e59739cbd3d admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:07.084132 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-00f44d52-4aa2-4c6d-8868-6e59739cbd3d admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Jun 02 13:29:07.084926 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 10/19] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:07.145845 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-bca767b4-1826-4dfa-a231-70c21d9a202a admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:07.169453 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-bca767b4-1826-4dfa-a231-70c21d9a202a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078121 Jun 02 13:29:07.169991 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 10/20] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Jun 2 13:29:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:29:09.682085 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-00f44d52-4aa2-4c6d-8868-6e59739cbd3d admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:09.683105 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-00f44d52-4aa2-4c6d-8868-6e59739cbd3d admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 02 13:29:09.683511 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 11/21] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:29:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:09.746220 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-a21c5a9b-f645-4a7c-8b89-9613339063e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "disk": 1, "id": "1", "name": "m1.tiny", "swap": 0}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:09.772574 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-a21c5a9b-f645-4a7c-8b89-9613339063e6 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082658 Jun 02 13:29:09.774633 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 11/22] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Jun 2 13:29:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:29:09.785867 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-ea5349cb-0778-43c2-8d05-911882ad3a0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:09.809598 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-ea5349cb-0778-43c2-8d05-911882ad3a0f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027932 Jun 02 13:29:09.810265 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 12/23] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Jun 2 13:29:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:29:12.126345 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-a21c5a9b-f645-4a7c-8b89-9613339063e6 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:12.127994 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-a21c5a9b-f645-4a7c-8b89-9613339063e6 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002920 Jun 02 13:29:12.128769 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:29:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:12.194182 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-0374a831-3ad9-46f7-b098-d73a1232aa9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:12.220684 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-0374a831-3ad9-46f7-b098-d73a1232aa9c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085616 Jun 02 13:29:12.226840 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 13/25] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Jun 2 13:29:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:12.233426 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-4bd36d71-012c-42c8-a693-8f0e60fbf5f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:12.258124 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-4bd36d71-012c-42c8-a693-8f0e60fbf5f8 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028313 Jun 02 13:29:12.258707 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 13/26] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Jun 2 13:29:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:29:14.529502 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-0374a831-3ad9-46f7-b098-d73a1232aa9c admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:14.530524 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-0374a831-3ad9-46f7-b098-d73a1232aa9c admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 02 13:29:14.530936 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 14/27] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:14.589675 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-a3b517c4-508f-44cf-9b45-5924a9dbe5bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "id": "3", "ram": 4096}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:14.607454 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-a3b517c4-508f-44cf-9b45-5924a9dbe5bb admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070801 Jun 02 13:29:14.608169 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 14/28] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Jun 2 13:29:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:29:14.619951 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-d9a65cc6-f4cb-4666-949a-c49ee2f8da4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:14.643405 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-d9a65cc6-f4cb-4666-949a-c49ee2f8da4d admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027144 Jun 02 13:29:14.643961 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 15/29] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Jun 2 13:29:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:16.919532 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-a3b517c4-508f-44cf-9b45-5924a9dbe5bb admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:16.920663 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-a3b517c4-508f-44cf-9b45-5924a9dbe5bb admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 02 13:29:16.921157 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 15/30] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:29:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:16.980097 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-0b0016f1-e786-408c-b665-ed102dd26a55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:16.999761 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-0b0016f1-e786-408c-b665-ed102dd26a55 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072129 Jun 02 13:29:17.000373 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 16/31] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Jun 2 13:29:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:17.015811 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-824cc009-b510-49f2-a6e6-0dc59ce37caf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:17.041048 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-824cc009-b510-49f2-a6e6-0dc59ce37caf admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032336 Jun 02 13:29:17.041908 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 16/32] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Jun 2 13:29:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:19.327958 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-0b0016f1-e786-408c-b665-ed102dd26a55 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:19.329548 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-0b0016f1-e786-408c-b665-ed102dd26a55 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Jun 02 13:29:19.329949 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 17/33] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:29:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:19.390070 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-79030e9f-f5f3-4f05-9d25-2efac9020015 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:19.409825 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-79030e9f-f5f3-4f05-9d25-2efac9020015 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073866 Jun 02 13:29:19.410373 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 17/34] 10.222.0.32 () {64 vars in 1282 bytes} [Thu Jun 2 13:29:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:19.421793 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-c0fcd256-2db2-4845-a324-6ecad053986c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:19.444455 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-c0fcd256-2db2-4845-a324-6ecad053986c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026105 Jun 02 13:29:19.448496 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 18/35] 10.222.0.32 () {64 vars in 1332 bytes} [Thu Jun 2 13:29:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:29:43.880682 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-79030e9f-f5f3-4f05-9d25-2efac9020015 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:43.881619 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-79030e9f-f5f3-4f05-9d25-2efac9020015 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 02 13:29:43.882015 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 18/36] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:29:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:43.892403 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:43.940654 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-2759097f-f34e-4f30-83e7-c96e393e61b2 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:43.957675 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-2759097f-f34e-4f30-83e7-c96e393e61b2 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069850 Jun 02 13:29:43.958214 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 19/37] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Jun 2 13:29:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:29:44.989520 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-79030e9f-f5f3-4f05-9d25-2efac9020015 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:44.990528 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-79030e9f-f5f3-4f05-9d25-2efac9020015 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 02 13:29:44.990925 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 19/38] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:29:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:45.187802 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-9b4a488b-2429-414a-8b3e-3f17ba868f1a admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:45.193560 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.wsgi [None req-9b4a488b-2429-414a-8b3e-3f17ba868f1a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-9b4a488b-2429-414a-8b3e-3f17ba868f1a admin admin] Request method failure captured: Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Accept: application/json Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Accept-Encoding: gzip, deflate Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Connection: keep-alive Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Content-Length: 0 Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Host: 10.222.0.32 Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Openstack-Api-Version: compute 2.90 Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Openstack-System-Scope: None Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: User-Agent: python-novaclient Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Auth-Token: gAAAAABimLtI860F9vY09Ckwlz5BLmNK9Sz3OSwlMu8uo3MXycazl_ZtrMIFmykE4XnQGkkW_CGQMUqWuCGRFKAC84ovnoSxQ9R3xg6jia4eu1Bvt5w8MxHXsmZ1sYVks_5rn9L8DGFHo8RkukjS1SXj0Hc4gW1-aFVj3e30LpvRw3zFWqMRUqY Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Domain-Id: None Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Domain-Name: None Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Identity-Status: Confirmed Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Is-Admin-Project: True Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Domain-Id: default Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Domain-Name: Default Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Name: admin Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Role: member,admin,reader Jun 02 13:29:45.196851 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Roles: member,admin,reader Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}] Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Tenant: admin Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Tenant-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Tenant-Name: admin Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User: admin Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Domain-Id: default Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Domain-Name: Default Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Id: 9c16757fd814428091339e7b09bd9627 Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Name: admin Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: method: > Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: exception: Flavor 42 could not be found. Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: action_args: {'id': '42'} Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:29:45.198537 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:45.199478 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:45.200735 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-9b4a488b-2429-414a-8b3e-3f17ba868f1a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:29:45.201811 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-9b4a488b-2429-414a-8b3e-3f17ba868f1a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060558 Jun 02 13:29:45.201811 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 20/39] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Jun 2 13:29:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:45.207916 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-79725abf-1ae3-4833-9b16-94be28da096e admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:45.211217 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:29:45.230629 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-79725abf-1ae3-4833-9b16-94be28da096e admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026267 Jun 02 13:29:45.231167 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 20/40] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Jun 2 13:29:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:29:45.241626 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-dd08138d-8b19-4b31-806e-c340ddf6c3ce admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:45.262371 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-dd08138d-8b19-4b31-806e-c340ddf6c3ce admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024425 Jun 02 13:29:45.262886 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 21/41] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Jun 2 13:29:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:29:45.273120 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e58412d8-9a1d-4220-9a47-2d22f8007c90 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:45.279167 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.wsgi [None req-e58412d8-9a1d-4220-9a47-2d22f8007c90 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e58412d8-9a1d-4220-9a47-2d22f8007c90 admin admin] Request method failure captured: Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Accept: application/json Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Accept-Encoding: gzip, deflate Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Connection: keep-alive Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Content-Length: 0 Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Host: 10.222.0.32 Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Openstack-Api-Version: compute 2.90 Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Openstack-System-Scope: None Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: User-Agent: python-novaclient Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Auth-Token: gAAAAABimLtI860F9vY09Ckwlz5BLmNK9Sz3OSwlMu8uo3MXycazl_ZtrMIFmykE4XnQGkkW_CGQMUqWuCGRFKAC84ovnoSxQ9R3xg6jia4eu1Bvt5w8MxHXsmZ1sYVks_5rn9L8DGFHo8RkukjS1SXj0Hc4gW1-aFVj3e30LpvRw3zFWqMRUqY Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Domain-Id: None Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Domain-Name: None Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Identity-Status: Confirmed Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Is-Admin-Project: True Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Domain-Id: default Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Domain-Name: Default Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Name: admin Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Role: member,admin,reader Jun 02 13:29:45.282932 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Roles: member,admin,reader Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}] Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Tenant: admin Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Tenant-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Tenant-Name: admin Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User: admin Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Domain-Id: default Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Domain-Name: Default Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Id: 9c16757fd814428091339e7b09bd9627 Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Name: admin Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: method: > Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: exception: Flavor 42 could not be found. Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: action_args: {'id': '42'} Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:29:45.284485 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:45.285464 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:45.286717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e58412d8-9a1d-4220-9a47-2d22f8007c90 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:29:45.288012 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-e58412d8-9a1d-4220-9a47-2d22f8007c90 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015872 Jun 02 13:29:45.288012 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 21/42] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Jun 2 13:29:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 02 13:29:46.150025 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-dd08138d-8b19-4b31-806e-c340ddf6c3ce admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:46.151043 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-dd08138d-8b19-4b31-806e-c340ddf6c3ce admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 02 13:29:46.151449 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 22/43] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:46.336351 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ae457268-1962-434c-9a5a-f3624ba6b626 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:46.342100 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.wsgi [None req-ae457268-1962-434c-9a5a-f3624ba6b626 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ae457268-1962-434c-9a5a-f3624ba6b626 admin admin] Request method failure captured: Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Accept: application/json Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Accept-Encoding: gzip, deflate Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Connection: keep-alive Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Content-Length: 0 Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Host: 10.222.0.32 Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Openstack-Api-Version: compute 2.90 Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Openstack-System-Scope: None Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: User-Agent: python-novaclient Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Auth-Token: gAAAAABimLtKwDVDLg7J8yZLZHdT2h0368BqiwgC6E6iESZggdehXihiek0tOcJiXL6CRSNqRoeRE7_-C_E9nRXxfS7uMfn_lHj5aeByQlkMoL4qQpziaURIz0R5XBe03aEf2LFi6uLNsbYBSYInD_LBTzPoLxvRb31xwwuF8rwMefHgtJR3W2Q Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Domain-Id: None Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Domain-Name: None Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Identity-Status: Confirmed Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Is-Admin-Project: True Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Domain-Id: default Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Domain-Name: Default Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Name: admin Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Role: member,admin,reader Jun 02 13:29:46.343595 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Roles: member,admin,reader Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}] Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Tenant: admin Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Tenant-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Tenant-Name: admin Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User: admin Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Domain-Id: default Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Domain-Name: Default Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Id: 9c16757fd814428091339e7b09bd9627 Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Name: admin Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: method: > Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: exception: Flavor 84 could not be found. Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: action_args: {'id': '84'} Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:29:46.344977 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:46.346010 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:46.347440 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ae457268-1962-434c-9a5a-f3624ba6b626 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:29:46.348742 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-ae457268-1962-434c-9a5a-f3624ba6b626 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059534 Jun 02 13:29:46.348742 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 22/44] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Jun 2 13:29:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 02 13:29:46.354663 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-04d9e146-13d6-49b1-846a-9f20d7f9a7b8 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:46.368424 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-04d9e146-13d6-49b1-846a-9f20d7f9a7b8 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017378 Jun 02 13:29:46.368946 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 23/45] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Jun 2 13:29:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:29:46.378423 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-fefa97de-95d3-4b95-ae2b-40f4d0f53199 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:46.391641 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-fefa97de-95d3-4b95-ae2b-40f4d0f53199 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017326 Jun 02 13:29:46.392155 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Jun 2 13:29:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:29:46.400768 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-9a6b4655-b279-43b3-acdb-737555475f74 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:46.405875 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.wsgi [None req-9a6b4655-b279-43b3-acdb-737555475f74 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-9a6b4655-b279-43b3-acdb-737555475f74 admin admin] Request method failure captured: Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Accept: application/json Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Accept-Encoding: gzip, deflate Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Connection: keep-alive Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Content-Length: 0 Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Host: 10.222.0.32 Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Openstack-Api-Version: compute 2.90 Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Openstack-System-Scope: None Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: User-Agent: python-novaclient Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Auth-Token: gAAAAABimLtKwDVDLg7J8yZLZHdT2h0368BqiwgC6E6iESZggdehXihiek0tOcJiXL6CRSNqRoeRE7_-C_E9nRXxfS7uMfn_lHj5aeByQlkMoL4qQpziaURIz0R5XBe03aEf2LFi6uLNsbYBSYInD_LBTzPoLxvRb31xwwuF8rwMefHgtJR3W2Q Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Domain-Id: None Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Domain-Name: None Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Identity-Status: Confirmed Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Is-Admin-Project: True Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Domain-Id: default Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Domain-Name: Default Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Name: admin Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Role: member,admin,reader Jun 02 13:29:46.407360 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Roles: member,admin,reader Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}] Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Tenant: admin Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Tenant-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Tenant-Name: admin Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User: admin Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Domain-Id: default Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Domain-Name: Default Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Id: 9c16757fd814428091339e7b09bd9627 Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Name: admin Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: method: > Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: exception: Flavor 84 could not be found. Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: action_args: {'id': '84'} Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:29:46.408940 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:46.410041 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:46.411378 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-9a6b4655-b279-43b3-acdb-737555475f74 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:29:46.412639 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-9a6b4655-b279-43b3-acdb-737555475f74 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011292 Jun 02 13:29:46.412639 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 24/47] 10.222.0.32 () {60 vars in 1190 bytes} [Thu Jun 2 13:29:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:47.262127 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-fefa97de-95d3-4b95-ae2b-40f4d0f53199 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:47.263068 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-fefa97de-95d3-4b95-ae2b-40f4d0f53199 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 02 13:29:47.263469 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 24/48] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:29:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:47.448866 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-afd6f78f-ac39-4ea6-921d-49cfb47f7ae8 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:47.454521 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.wsgi [None req-afd6f78f-ac39-4ea6-921d-49cfb47f7ae8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-afd6f78f-ac39-4ea6-921d-49cfb47f7ae8 admin admin] Request method failure captured: Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Accept: application/json Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Accept-Encoding: gzip, deflate Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Connection: keep-alive Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Content-Length: 0 Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Host: 10.222.0.32 Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Openstack-Api-Version: compute 2.90 Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Openstack-System-Scope: None Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: User-Agent: python-novaclient Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Auth-Token: gAAAAABimLtLGQixetYXUcXy1py4YNiRnP__TGKG6XCQM_tbxEfVPlhiSP7pmULbrTTPR3aUEddQ-E96hsxCY1QyCbZDRj7lW9dcyrv_I1Xd5Bf8EVFYvdJ6BCri_5IQjHpimbFOhzcpv5Bhfo3MqS1bwlWMvht3FdCjuJqdXaSobTR6lhkBaWQ Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Domain-Id: None Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Domain-Name: None Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Identity-Status: Confirmed Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Is-Admin-Project: True Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Domain-Id: default Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Domain-Name: Default Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Project-Name: admin Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Role: member,admin,reader Jun 02 13:29:47.456017 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Roles: member,admin,reader Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}] Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Tenant: admin Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Tenant-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-Tenant-Name: admin Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User: admin Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Domain-Id: default Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Domain-Name: Default Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Id: 9c16757fd814428091339e7b09bd9627 Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: X-User-Name: admin Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: method: > Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: exception: Flavor 451 could not be found. Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: action_args: {'id': '451'} Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:29:47.457530 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:47.458358 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 02 13:29:47.460048 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-afd6f78f-ac39-4ea6-921d-49cfb47f7ae8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:29:47.461527 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-afd6f78f-ac39-4ea6-921d-49cfb47f7ae8 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059313 Jun 02 13:29:47.461527 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 25/49] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Jun 2 13:29:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:47.467140 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-23ef4f50-fdc9-48c9-97a8-f71c1cfb916d admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:47.480886 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-23ef4f50-fdc9-48c9-97a8-f71c1cfb916d admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017260 Jun 02 13:29:47.481395 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 25/50] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Jun 2 13:29:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:29:47.491155 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:47.504486 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016751 Jun 02 13:29:47.504998 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 26/51] 10.222.0.32 () {60 vars in 1210 bytes} [Thu Jun 2 13:29:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:29:47.513717 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-42fe3a63-823b-4083-bb03-cb32c34a3a65 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:47.518772 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.wsgi [None req-42fe3a63-823b-4083-bb03-cb32c34a3a65 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-42fe3a63-823b-4083-bb03-cb32c34a3a65 admin admin] Request method failure captured: Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Accept: application/json Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Accept-Encoding: gzip, deflate Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Connection: keep-alive Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Content-Length: 0 Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Host: 10.222.0.32 Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Openstack-Api-Version: compute 2.90 Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Openstack-System-Scope: None Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: User-Agent: python-novaclient Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Auth-Token: gAAAAABimLtLGQixetYXUcXy1py4YNiRnP__TGKG6XCQM_tbxEfVPlhiSP7pmULbrTTPR3aUEddQ-E96hsxCY1QyCbZDRj7lW9dcyrv_I1Xd5Bf8EVFYvdJ6BCri_5IQjHpimbFOhzcpv5Bhfo3MqS1bwlWMvht3FdCjuJqdXaSobTR6lhkBaWQ Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Domain-Id: None Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Domain-Name: None Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Identity-Status: Confirmed Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Is-Admin-Project: True Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Domain-Id: default Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Domain-Name: Default Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Project-Name: admin Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Role: member,admin,reader Jun 02 13:29:47.520247 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Roles: member,admin,reader Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0c7119c3fda547cdad0db42ad18b471e"}]}] Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Tenant: admin Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Tenant-Id: 0c7119c3fda547cdad0db42ad18b471e Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-Tenant-Name: admin Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User: admin Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Domain-Id: default Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Domain-Name: Default Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Id: 9c16757fd814428091339e7b09bd9627 Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: X-User-Name: admin Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: method: > Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: exception: Flavor 451 could not be found. Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: action_args: {'id': '451'} Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:29:47.521814 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:47.522951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 02 13:29:47.524521 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-42fe3a63-823b-4083-bb03-cb32c34a3a65 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:29:47.525819 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-42fe3a63-823b-4083-bb03-cb32c34a3a65 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011323 Jun 02 13:29:47.525819 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 26/52] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Jun 2 13:29:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 13:29:48.379430 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:48.380503 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 02 13:29:48.380923 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 27/53] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:29:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:48.565585 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-6cba4b53-171b-4bcd-bb47-a4f1a23fb098 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:48.583150 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-6cba4b53-171b-4bcd-bb47-a4f1a23fb098 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068168 Jun 02 13:29:48.583693 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 27/54] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Jun 2 13:29:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:49.437204 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:49.438237 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 02 13:29:49.438630 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 28/55] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:29:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:49.624860 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-4ce98500-0c5a-4905-8574-1afdbdf2db37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:49.642417 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-4ce98500-0c5a-4905-8574-1afdbdf2db37 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068383 Jun 02 13:29:49.642955 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 28/56] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Jun 2 13:29:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 13:29:50.504369 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:50.505383 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 02 13:29:50.505783 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 29/57] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:29:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:50.690930 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-0d66716f-ee8e-4b44-866a-9b176d6a0af5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:50.709335 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-0d66716f-ee8e-4b44-866a-9b176d6a0af5 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070204 Jun 02 13:29:50.710134 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 29/58] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Jun 2 13:29:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:51.566068 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:51.567075 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 02 13:29:51.567471 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 30/59] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:29:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:51.752736 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e996c7c6-305c-4d44-920e-c4a0d6410691 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:29:51.769986 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-e996c7c6-305c-4d44-920e-c4a0d6410691 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068290 Jun 02 13:29:51.770516 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 30/60] 10.222.0.32 () {64 vars in 1235 bytes} [Thu Jun 2 13:29:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:29:52.624983 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:52.625994 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 02 13:29:52.626396 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 31/61] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:29:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:29:52.812908 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-00668356-bd03-4a16-9097-11dfdb544eb4 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:29:52.832470 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-00668356-bd03-4a16-9097-11dfdb544eb4 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070315 Jun 02 13:29:52.833017 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 31/62] 10.222.0.32 () {60 vars in 1202 bytes} [Thu Jun 2 13:29:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:53.668932 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:53.669971 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-c6baee60-8c12-4f89-b18f-00218ab20491 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 02 13:30:53.670405 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 32/63] 10.222.0.32 () {54 vars in 930 bytes} [Thu Jun 2 13:30:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:30:53.677514 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:53.729061 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-34a20dee-8c29-4eac-bdec-a0dc8b9a3100 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:53.747626 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-34a20dee-8c29-4eac-bdec-a0dc8b9a3100 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071527 Jun 02 13:30:53.748149 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 32/64] 10.222.0.32 () {60 vars in 1291 bytes} [Thu Jun 2 13:30:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:30:53.768650 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=14 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:30:53.772625 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-35e66a7c-0bf0-4502-88d7-d68205c01679 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:53.780944 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-35e66a7c-0bf0-4502-88d7-d68205c01679 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013730 Jun 02 13:30:53.781465 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 33/65] 10.222.0.32 () {60 vars in 1282 bytes} [Thu Jun 2 13:30:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:53.792541 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-88b8353e-dcfa-4de6-ae79-58af385707a7 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:53.799988 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-88b8353e-dcfa-4de6-ae79-58af385707a7 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010928 Jun 02 13:30:53.800570 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 33/66] 10.222.0.32 () {60 vars in 1285 bytes} [Thu Jun 2 13:30:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:53.811310 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-05ad54a1-9cac-4201-9328-bb667694ec41 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:53.818616 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-05ad54a1-9cac-4201-9328-bb667694ec41 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010749 Jun 02 13:30:53.819127 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 34/67] 10.222.0.32 () {60 vars in 1285 bytes} [Thu Jun 2 13:30:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:30:53.831180 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-fa588af3-2f0e-454a-b81d-bdf6c78e2e79 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:30:53.838893 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-fa588af3-2f0e-454a-b81d-bdf6c78e2e79 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011655 Jun 02 13:30:53.839957 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 34/68] 10.222.0.32 () {60 vars in 1282 bytes} [Thu Jun 2 13:30:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:34:07.330719 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-05ad54a1-9cac-4201-9328-bb667694ec41 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:07.331991 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-05ad54a1-9cac-4201-9328-bb667694ec41 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 02 13:34:07.332409 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 35/69] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:34:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:34:07.485738 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=6 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:07.596586 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-715ee521-e590-4652-810e-74185b311cae admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:07.597752 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:34:07.597752 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 02 13:34:07.598971 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-715ee521-e590-4652-810e-74185b311cae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:07.599408 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-715ee521-e590-4652-810e-74185b311cae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:07.600180 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-715ee521-e590-4652-810e-74185b311cae admin admin] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:07.600628 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-715ee521-e590-4652-810e-74185b311cae admin admin] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:07.634233 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-715ee521-e590-4652-810e-74185b311cae admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149967 Jun 02 13:34:07.635310 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 35/70] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Jun 2 13:34:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:34:08.508357 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-05ad54a1-9cac-4201-9328-bb667694ec41 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:08.509371 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-05ad54a1-9cac-4201-9328-bb667694ec41 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 02 13:34:08.509791 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 36/71] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:34:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:34:08.695755 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-954b9478-dbd4-4235-ad0b-9a5af65a54de admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:08.696950 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:34:08.696950 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 02 13:34:08.698363 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-954b9478-dbd4-4235-ad0b-9a5af65a54de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:08.698798 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-954b9478-dbd4-4235-ad0b-9a5af65a54de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:08.699579 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-954b9478-dbd4-4235-ad0b-9a5af65a54de admin admin] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:08.700000 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-954b9478-dbd4-4235-ad0b-9a5af65a54de admin admin] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:08.720435 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-954b9478-dbd4-4235-ad0b-9a5af65a54de admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075580 Jun 02 13:34:08.720914 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 36/72] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Jun 2 13:34:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:34:20.005394 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-05ad54a1-9cac-4201-9328-bb667694ec41 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:20.006401 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-05ad54a1-9cac-4201-9328-bb667694ec41 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 02 13:34:20.007084 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 37/73] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:34:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:34:20.147511 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell0:SELECT=4 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:20.148341 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell1:SELECT=4 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:20.148951 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=8 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:20.198835 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-dd669c22-4ced-447b-8c20-e45de779f5db admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:20.199987 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:34:20.199987 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 02 13:34:20.201186 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-dd669c22-4ced-447b-8c20-e45de779f5db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:20.201620 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-dd669c22-4ced-447b-8c20-e45de779f5db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:20.202395 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-dd669c22-4ced-447b-8c20-e45de779f5db admin admin] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:20.202875 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-dd669c22-4ced-447b-8c20-e45de779f5db admin admin] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:20.227544 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-dd669c22-4ced-447b-8c20-e45de779f5db admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084417 Jun 02 13:34:20.228113 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 37/74] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Jun 2 13:34:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:34:21.105225 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-05ad54a1-9cac-4201-9328-bb667694ec41 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:21.106233 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-05ad54a1-9cac-4201-9328-bb667694ec41 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 02 13:34:21.106634 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 38/75] 10.222.0.32 () {56 vars in 1074 bytes} [Thu Jun 2 13:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:34:21.296362 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-6f0c801e-0a02-4d11-8ae9-45fff46a56d9 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:34:21.297561 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:34:21.297561 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 02 13:34:21.298754 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-6f0c801e-0a02-4d11-8ae9-45fff46a56d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:21.299192 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-6f0c801e-0a02-4d11-8ae9-45fff46a56d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:21.299960 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-6f0c801e-0a02-4d11-8ae9-45fff46a56d9 admin admin] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:34:21.300413 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-6f0c801e-0a02-4d11-8ae9-45fff46a56d9 admin admin] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:34:21.322517 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-6f0c801e-0a02-4d11-8ae9-45fff46a56d9 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080101 Jun 02 13:34:21.323048 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 38/76] 10.222.0.32 () {60 vars in 1193 bytes} [Thu Jun 2 13:34:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:35:19.056213 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: Thu Jun 2 13:35:19 2022 - graceful shutdown triggered... Jun 02 13:35:19.056347 dv-cinder-836083-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 02 13:35:19.057757 dv-cinder-836083-8-iscsi devstack@n-api.service[103268]: Gracefully killing worker 1 (pid: 103268)... Jun 02 13:35:19.058139 dv-cinder-836083-8-iscsi devstack@n-api.service[103269]: Gracefully killing worker 2 (pid: 103269)... Jun 02 13:35:20.058572 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: worker 1 buried after 1 seconds Jun 02 13:35:20.058572 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: worker 2 buried after 1 seconds Jun 02 13:35:20.058572 dv-cinder-836083-8-iscsi devstack@n-api.service[103267]: goodbye to uWSGI. Jun 02 13:35:20.060091 dv-cinder-836083-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 02 13:35:20.060701 dv-cinder-836083-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 02 13:35:20.063489 dv-cinder-836083-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 13:35:20.077383 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:35:20 2022] *** Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: nodename: dv-cinder-836083-8-iscsi Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: machine: x86_64 Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: clock source: unix Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: pcre jit disabled Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: detected number of CPU cores: 4 Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: current working directory: / Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:35:20.097335 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: your processes number limit is 47680 Jun 02 13:35:20.098102 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: your memory page size is 4096 bytes Jun 02 13:35:20.098102 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: detected max file descriptor number: 2048 Jun 02 13:35:20.098102 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: lock engine: pthread robust mutexes Jun 02 13:35:20.098102 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: thunder lock: enabled Jun 02 13:35:20.098102 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 13:35:20.098102 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:35:20.144237 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: Python main interpreter initialized at 0x5563209cf9c0 Jun 02 13:35:20.144237 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: python threads support enabled Jun 02 13:35:20.144237 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: your server socket listen backlog is limited to 100 connections Jun 02 13:35:20.144237 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:35:20.144762 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:35:20.144762 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: *** Operational MODE: preforking *** Jun 02 13:35:20.145005 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:35:20.145005 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: spawned uWSGI master process (pid: 124101) Jun 02 13:35:20.145213 dv-cinder-836083-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 13:35:20.146561 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: spawned uWSGI worker 1 (pid: 124122, cores: 1) Jun 02 13:35:20.146561 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: spawned uWSGI worker 2 (pid: 124123, cores: 1) Jun 02 13:35:20.146561 dv-cinder-836083-8-iscsi devstack@n-api.service[124101]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:35:21.382436 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:35:21.383774 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 13:35:22.204319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:35:22.204319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: from cryptography.utils import int_from_bytes Jun 02 13:35:22.204671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:35:22.204671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: from cryptography.utils import int_from_bytes Jun 02 13:35:22.218008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:35:22.218008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: from cryptography.utils import int_from_bytes Jun 02 13:35:22.218474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:35:22.218474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: from cryptography.utils import int_from_bytes Jun 02 13:35:24.590772 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:35:24.591766 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:35:24.592333 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:35:24.592716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:35:24.592979 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:35:24.593379 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.593715 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.594044 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.594366 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.594703 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.595019 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.595355 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.595677 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.596009 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.596277 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.596627 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.596958 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-8-iscsi {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.597290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.597606 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.597924 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.598252 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.598564 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.598901 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.599216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.599733 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.600513 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.600835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.601258 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.601630 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.601941 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.602277 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.602590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.602908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.603245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.604329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.604329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-8-iscsi {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.604329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.604710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.604974 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.605400 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.605718 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.606037 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.606368 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.606703 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.607020 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.607355 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.607826 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.608008 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.608346 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.608674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.608976 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.609302 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.609630 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.609944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.610261 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.610514 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.610831 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.611160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.611470 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:35:24.611914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.612006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:35:24.612088 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.612088 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.612403 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:35:24.612515 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.612620 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.612705 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:35:24.612918 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:35:24.613029 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.613254 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.613355 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.613569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.613671 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.613881 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.613983 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.614192 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.614295 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.614504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.614606 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.614815 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.614940 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.615125 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.615234 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.615438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.615540 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.615769 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.615872 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.616089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.616202 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.616448 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.616564 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.616765 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.616876 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-8-iscsi {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.617093 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.617204 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.617409 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.617569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.617730 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.617878 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.618034 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.618188 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.618342 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.618502 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.618668 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.618816 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.618971 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.619130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.619347 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.619517 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.619683 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.619839 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.619993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.620149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.620336 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.620503 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.620681 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.620829 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.620984 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.621140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.621303 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.621460 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.621607 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.621754 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.621911 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.622065 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.622227 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.622375 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.622539 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.622697 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.622844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.623007 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.623161 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-8-iscsi {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.623329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.623487 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.623634 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.623781 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.623944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.624099 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.624254 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.624438 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.624609 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.624770 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.624926 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.625073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.625219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.625366 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.625522 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.625751 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.630415 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.630620 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.630791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.630791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.631111 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.631274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.631435 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.631586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.631742 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.631891 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.632038 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.632196 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.632377 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.632531 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.632678 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.632836 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.633000 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.633167 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.633315 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.633470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.633625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.633773 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.633919 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.634066 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.634212 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.634372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.634528 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.634685 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.635353 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.635510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.637298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.637480 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.637669 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.637827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.637987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.637987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.637987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.638433 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.638590 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.638777 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.638944 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.639113 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.639274 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.639429 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.639613 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.639772 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.639932 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.640080 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.640236 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.640420 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.640895 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.641060 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.641218 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.641382 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.643290 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.643471 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.643628 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.643780 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.643930 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.644090 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.644241 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.644417 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.644567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.644714 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.644871 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.645040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.645299 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.645483 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.645640 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.645796 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.645943 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.646120 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.648485 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.648676 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.648837 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.649000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.649162 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.649326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.649485 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.649647 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.649804 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.649952 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.650108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.650265 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.650465 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.651189 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.651345 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.651492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.651596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.651686 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.651777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.651881 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.651993 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.652091 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.652189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.652277 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.652379 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.652467 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.652568 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.652665 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.652753 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.652847 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.652941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.653036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.653123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.653123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.653290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.653376 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.653472 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.653561 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.653655 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.653752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.653839 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.653931 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.654017 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.654103 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.654196 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.654300 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.654394 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.654482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.654567 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.654660 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.654746 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.654845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.654933 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.655018 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.655110 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.655197 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.655296 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.655398 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.655492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.655592 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.655679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.655765 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.655859 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.655946 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.656039 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.656138 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.656234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.656353 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.656466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.656584 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.656671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.656771 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.656859 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.656944 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.657030 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.657115 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.657200 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.661532 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.661655 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.661759 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.661851 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.661941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.662043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.662140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.662228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.662228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.662228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.662475 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.662573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.662573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.662573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.662573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.662573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.662956 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.663130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.663130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.663130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.663130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.663450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.663544 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.663544 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.663544 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.663544 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.663544 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.663926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.664019 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.664019 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.664019 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.664266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.664374 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.664463 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.664549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.664650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.664751 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.664848 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.664935 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.665030 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.665125 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.665221 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.665309 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.665400 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.665486 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.665572 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.665657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.665760 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.665857 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.665946 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.666061 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.666164 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.666252 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.666348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.666435 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.666529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.666622 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.666716 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.666803 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.666803 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.666803 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.666803 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.666803 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.666803 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.667272 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:35:24.667359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.667359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.667359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.667359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.667359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.667359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.671748 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.671844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.671844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.671844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.671844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.671844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.672341 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.672451 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.672451 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.672451 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.672451 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.672785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.672873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.672967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.673061 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.673149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.673250 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.673346 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.675553 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.675841 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.676017 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.676114 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.676202 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.676286 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.676493 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.676629 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.676719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.676719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.677198 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.677198 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.677420 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.677568 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.677715 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.678064 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.678181 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.678181 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.678181 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.678181 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.678506 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.679217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.679217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.679217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.679217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.679217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.679962 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.680066 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.680066 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.680720 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.680869 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.680975 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.681071 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.681168 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.682227 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.682376 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.682482 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.682482 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.682482 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.682725 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.682813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.682813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.682813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.682813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.683149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.683455 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.683455 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.683455 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.683702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.683797 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.683797 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.683970 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.684056 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.684056 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.684056 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.685423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686153 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686685 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686779 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686866 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686866 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686866 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.686866 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.687183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.687268 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.687268 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.687268 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.688895 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.689002 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.689112 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.689215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.689303 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.690603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.690603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.690603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.690603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.690603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.691068 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.691165 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.691165 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.691165 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.691407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.691614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.691745 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.691851 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.691940 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.692025 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.692118 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.692205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.692205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.692205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694079 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694184 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694378 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694467 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694562 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694662 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.694748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.695205 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.695302 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.695302 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.695302 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.695584 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.695696 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.695905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696007 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696102 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696189 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696739 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.696827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.697137 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.697246 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.697246 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.697246 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.697246 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.697246 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.698136 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.698136 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.698681 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.698796 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.698936 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.699075 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.699377 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.699481 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.699696 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.700234 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.700374 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.700374 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.700554 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.700649 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.701130 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.701255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.701568 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.701663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.701886 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.702615 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.702714 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.702803 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.702898 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.702898 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.703252 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.703504 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.703613 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.703819 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.703959 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.704331 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.704444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.704544 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.704763 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.705036 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.705147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.705379 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.705888 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.706262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.706262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.706425 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.706541 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.706855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.706949 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.707169 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.707474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.707578 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.707776 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.708081 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.708218 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.708440 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.708753 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.708855 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.709072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.709370 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.709475 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.709700 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.710816 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.710944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.711043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.711131 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.711230 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.711319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.711319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.711476 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.711561 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.711561 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.711874 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.712040 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.712209 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.712576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.712675 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.712913 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.713234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.713342 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.713669 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.713836 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.713949 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.714494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.714618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.714723 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.714813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.714980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.715076 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.715357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.715784 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.715931 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.716060 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.716153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.716269 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.716622 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.716717 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.716930 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.717207 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.717344 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.717537 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.717723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.717857 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.718101 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.718238 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.718379 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.718522 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.718713 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.718850 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.719031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.719176 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.719349 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.719500 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.719657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.719802 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.719967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.720543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.720543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.720820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.720820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.721070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.721209 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.721349 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.721349 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.721609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.721750 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.721891 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.722023 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.722154 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.722293 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.722433 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.722564 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.722695 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.722826 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.722964 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.723105 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.723407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.723542 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.723682 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.723965 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.724134 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.724282 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.724437 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.724676 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.724826 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.724962 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.725103 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.725248 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.725381 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.725512 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.725650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.725782 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.725997 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.726139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.726272 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.726402 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.726533 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.726683 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.726828 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.726963 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.727094 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.727232 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.727373 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.727506 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.727647 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.727779 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.727910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.728050 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.728182 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.728350 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.728508 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.728655 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.728790 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.728920 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.729051 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.729192 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.729325 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.729463 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.729602 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.729736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.729874 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.730018 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.730251 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.730475 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.731165 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.731439 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.731714 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.731865 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.732054 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.732222 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.732459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.732598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.732815 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.732950 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.733090 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.733090 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.733532 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.733685 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.733861 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.734092 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.734228 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.734361 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.734502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.734669 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.734849 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.734985 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.735124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.735377 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.735520 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.735660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.735809 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.735970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.736113 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.736255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.736486 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.736666 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.736812 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.736945 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.737084 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.737231 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.737372 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.737657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.737807 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.737981 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.738843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.738959 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.739072 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.739196 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.739321 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.739435 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.739557 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.739678 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.739801 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.739936 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.740100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.740259 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.740570 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.740876 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.740999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.741123 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.741238 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.741386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.741515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.741646 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.741771 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.741894 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.742007 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.742083 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.742210 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.742286 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.742403 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.742511 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.742601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.742689 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.742782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.743578 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.743702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.743793 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.743880 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.743965 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.744060 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.744767 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.744861 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.744951 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.745045 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.745132 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.745226 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.745336 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.745426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.745646 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.745754 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.745843 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.745937 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.746023 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.746023 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.746023 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.746023 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.746414 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.746489 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.746614 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.746700 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.746944 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.747044 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.747348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.747447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.747596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.747701 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.747895 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.748097 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.748255 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.748388 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.748604 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.748708 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.748912 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.749015 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.749229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.749337 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.749562 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.749703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.749873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.749977 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.750183 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.750287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.750497 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.750637 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.750836 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.750954 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.751148 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.751297 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.751477 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.751582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.751810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.751914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.752127 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.752233 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.752465 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.752570 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.752799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.752972 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.753083 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.753292 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.753415 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.753611 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.753732 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.753944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.754055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.754276 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.754379 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.754609 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.754705 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.754923 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.755042 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.755244 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.755348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.755561 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.755833 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.755940 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.756173 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.756268 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.756518 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.756624 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.756841 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.756947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.757151 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.757244 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.757482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.757592 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.757804 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.757914 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.758125 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.758219 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.758457 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.758553 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.758766 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.758876 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.759084 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.759179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.759397 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.759493 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.759706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.759850 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.760586 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.760717 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.760898 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.761033 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.761209 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.761345 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.761524 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.761661 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.761838 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.761972 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.762148 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.762282 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.762456 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.762612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.762762 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.762922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.763070 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.763239 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.763386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.763553 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.763693 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.763865 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.764006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.764176 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.764338 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.764513 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.764671 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.764843 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.764987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.765155 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.765292 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.765465 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.765599 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.765789 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.765904 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.766118 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.766250 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.766448 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.766549 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.766760 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.766885 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.767089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.767218 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.767401 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.767565 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.767720 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.767994 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.768118 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.768336 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.768443 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.768676 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.768781 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.768984 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.769110 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.769294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.769410 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.769603 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.769711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.769913 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.770023 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.770221 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.770316 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.770527 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.770622 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.770840 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.770942 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.771156 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.771259 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.771468 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.771563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.771780 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.771889 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.772085 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.772188 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.772417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.772516 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.772726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.772832 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.773044 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.773147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.773356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.773449 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.773660 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.773762 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.773964 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.774060 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.774271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.774364 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.774576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.774669 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.774879 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.774980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.775189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.775283 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.775520 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.775629 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.775837 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.775932 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.776143 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.776238 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.776492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.776660 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.776784 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.776975 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.777091 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.777287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.777439 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.777598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.777749 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.777905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.778092 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.778231 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.778418 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.778542 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.778747 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.778841 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.779081 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.779189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.779396 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.779489 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.779722 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.779815 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.780026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.780130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.780350 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.780461 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.780678 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.780779 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.780999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.781095 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.781301 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.781395 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.781611 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.781705 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.781914 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.782017 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.782217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.782312 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.782522 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.782616 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.782827 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.782932 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.783131 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.783228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.783431 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.783688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.783794 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.784021 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.784116 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.784339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.784449 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.784669 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.784767 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.784975 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.785078 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.785277 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.785388 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.785583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.785702 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.785887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.785995 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.786195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.786298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.786508 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.786603 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.786822 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.786917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.787152 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.787250 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.787466 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.787558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.787786 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.787882 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.788096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.788199 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.788427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.788525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.788745 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.788855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.789052 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.789147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.789367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.789460 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.789677 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.789781 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.789992 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.790086 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.790297 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.790398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.790600 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.790708 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.790930 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.791053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.791268 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.791367 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.791580 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.791675 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.791894 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.791987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.792210 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.792378 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.792551 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.792649 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.792863 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.792962 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.793172 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.793272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.793482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.793578 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.793789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.793893 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.794099 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.794193 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.794407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.794510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.794716 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.794811 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.795026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.795131 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.795336 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.795438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.795648 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.795765 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.795959 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.796174 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.796270 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.796518 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.796615 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.796859 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.796954 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.797179 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.797282 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.797507 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.797601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.797817 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.797910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.798123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.798219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.798433 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.798527 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.798737 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.798840 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.799045 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.799148 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.799351 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.799453 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.799660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.799790 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.799971 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.800104 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.800334 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.800445 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.800637 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.800741 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.800949 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.801040 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.801271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.801366 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.801584 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.801694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.801942 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.802119 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.802248 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.802476 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.802668 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.802798 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.802982 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.803132 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.803293 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.803464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.803604 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.803810 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.803909 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.804127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.804218 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.804495 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.804607 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.804811 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.804914 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.805123 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.805216 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.805425 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.805531 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.805746 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.805846 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.806055 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.806149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.806364 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.806459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.807211 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.807325 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.807588 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.807676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.807902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.808011 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.808234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.808360 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.808551 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.808646 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.808884 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.808980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.809195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.809290 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.809505 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.809613 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.809814 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.809917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.810129 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.810223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.810439 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.810543 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.810754 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.810857 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.811065 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.811155 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.811375 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.811482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.811692 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.811787 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.812001 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.812103 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.812333 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.812473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.812642 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.812748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.812956 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.813050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.813268 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.813372 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.813580 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.813683 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.813903 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.813996 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.814268 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.814357 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.814578 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.814672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.814926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.815019 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.815249 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.815344 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.815563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.815657 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.815870 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.815963 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.816178 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.816281 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.816514 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.816619 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.816819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.816988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.817124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.817220 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.817449 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.817714 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.817816 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.818051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.818153 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.818359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.818454 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.818667 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.818775 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.818973 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.819087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.819275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.819370 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.819600 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.819702 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.819905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.820000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.820230 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.820356 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.820571 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.820674 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.820890 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.820991 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.821202 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.821290 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.821507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.821609 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.821818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.821911 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.822126 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.822218 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.822980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.823096 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.823289 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.823386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.823594 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.823687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.823905 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.824003 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.824219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.824371 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.824563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.824660 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.824878 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.824981 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.825197 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.825291 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.825509 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.825604 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.825846 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.825942 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.826161 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.826249 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.826480 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.826562 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.826799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.826892 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.827113 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.827212 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.827421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.827519 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.827727 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.827823 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.828038 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.828140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.828358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.828469 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.828667 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.828766 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.828972 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.829055 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.829280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.829386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.829584 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.829723 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.829886 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.830045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.830191 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.830368 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.830520 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.830696 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.830826 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.831265 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.831407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.831595 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.831717 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.831926 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.832027 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.832241 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.832364 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.832594 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.832689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.832910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.833005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.833245 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.833352 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.833582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.833685 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.833901 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.833995 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.834226 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.834329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.834536 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.834638 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.834846 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.834940 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.835157 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.835263 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.835469 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.835569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.835783 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.835878 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.836096 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.836198 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.836430 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.836539 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.836741 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.836840 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.837051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.837153 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.837355 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.837456 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.837663 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.837770 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.837994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.838093 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.838307 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.838410 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.838622 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.838725 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.838930 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.839144 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.839239 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.839471 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.839565 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.839785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.839880 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.840095 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.840190 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.840431 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.840545 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.840746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.840889 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.841050 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.841154 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.841357 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.841461 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.841662 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.841762 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.841969 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.842071 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.842274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.842380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.842597 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.842691 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.842917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.843011 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.843242 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.843344 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.843569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.843671 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.843881 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.843974 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.844196 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.844317 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.844534 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.844624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.844845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.844937 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.845178 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.845279 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.845498 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.845593 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.845803 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.845897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.846114 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.846218 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.846427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.846531 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.846740 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.846910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.847217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.847374 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.847461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.847549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.847740 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.847846 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.848068 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.848179 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.848539 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.848808 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.848906 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.849122 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.849250 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.849455 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.849724 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.849835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.850086 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.850183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.850407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.850501 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.850728 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.850833 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.851063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.851168 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.851378 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.851487 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.851692 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.851791 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.852013 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.852109 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.852347 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.852651 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.852748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.852971 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.853074 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.853291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.853394 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.853640 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.853742 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.853975 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.854069 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.854291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.854393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.854617 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.854718 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.854950 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.855043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.855265 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.855358 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.855583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.855677 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.855904 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.856000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.856222 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.856334 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.856564 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.856678 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.856898 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.856994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.857217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.857319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.857464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:35:24.857586 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.857848 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.858163 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.858704 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.859063 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.859387 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.859722 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.860055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.860423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.860743 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.861075 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.861389 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.861702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.862144 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.862344 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.862654 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.862967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.863282 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.863596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.863907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.864222 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.864553 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.864887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.865199 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.865509 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.865818 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.866133 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.866443 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.866753 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.867062 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.867374 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.867691 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.868006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.868349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.868649 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.868965 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.869769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.870082 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.870444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.870773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.871082 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.871389 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.871709 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.872025 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.872380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.872701 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.873015 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.873364 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.873683 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.874225 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.874569 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.874898 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.875242 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.875582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.875900 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.876212 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.876548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.876880 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.877195 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.877509 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.877829 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.878142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.878455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.878767 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.879080 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.879392 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.879705 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.880016 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.880385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.880685 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.880998 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.881317 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.881662 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.881984 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.882303 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.882621 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.882942 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.883256 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.883569 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.883882 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.884196 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.884538 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.885521 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.885840 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.886155 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.886587 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.886908 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.887233 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.887558 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.887874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.888206 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.888558 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.888877 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.889201 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.889516 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.889849 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.890192 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.890526 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.890856 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.891167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.891476 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.891782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.892093 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.892436 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.892754 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.893061 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.893367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.893678 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.893982 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.894289 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.894596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.894903 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.895215 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.895524 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.895833 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.896139 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.896467 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.896776 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.897082 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.897392 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.897698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.898010 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.898315 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.898620 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.898930 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.899262 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.899599 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.899914 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.900250 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.900577 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.900902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.901212 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.901536 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.901861 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.902176 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.902489 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.902823 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.903135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.903449 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.903759 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.904069 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.904401 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.904715 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.905042 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.905368 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.905677 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.906005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.906323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.906644 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.906960 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.907270 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.907603 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.907918 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.908229 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.908572 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.908883 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.909196 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.909508 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.909823 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.910153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.910485 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.910793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.911122 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.911454 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.911804 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.912120 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.912491 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.912826 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.913145 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.913457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.913765 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:35:24.914009 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:35:24.917278 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO dbcounter [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Registered counter for database nova_api Jun 02 13:35:24.937680 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_db.sqlalchemy.engines [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:35:24.944966 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writer thread running {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:35:24.975667 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO dbcounter [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Registered counter for database nova_api Jun 02 13:35:24.995726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_db.sqlalchemy.engines [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:35:25.002327 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writer thread running {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:35:25.003976 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.context [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),309ea19d-aef7-4c6c-9f87-a5fdcea29505(cell1) {{(pid=124122) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:35:25.008242 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:25.013053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:25.013053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:25.013708 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:25.015716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO dbcounter [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Registered counter for database nova_cell0 Jun 02 13:35:25.019903 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO dbcounter [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Registered counter for database nova_cell1 Jun 02 13:35:25.027311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_db.sqlalchemy.engines [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:35:25.029468 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_db.sqlalchemy.engines [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:35:25.036575 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writer thread running {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:35:25.038074 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writer thread running {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:35:25.061174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.context [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),309ea19d-aef7-4c6c-9f87-a5fdcea29505(cell1) {{(pid=124123) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 13:35:25.065293 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:25.066885 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:25.067692 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:35:25.069696 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:35:25.071642 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO dbcounter [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Registered counter for database nova_cell0 Jun 02 13:35:25.076163 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO dbcounter [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Registered counter for database nova_cell1 Jun 02 13:35:25.083652 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_db.sqlalchemy.engines [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:35:25.085053 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_db.sqlalchemy.engines [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:35:25.092449 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writer thread running {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:35:25.092725 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writer thread running {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:35:25.190221 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO dbcounter [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Registered counter for database nova_cell0 Jun 02 13:35:25.197244 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_db.sqlalchemy.engines [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:35:25.201639 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writer thread running {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:35:25.246463 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO dbcounter [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Registered counter for database nova_cell0 Jun 02 13:35:25.253435 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_db.sqlalchemy.engines [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:35:25.257756 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writer thread running {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:35:25.649262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: WARNING keystonemiddleware.auth_token [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:35:25.657336 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: WARNING keystonemiddleware.auth_token [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:35:25.754343 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: WARNING keystonemiddleware.auth_token [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:35:25.762458 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: WARNING keystonemiddleware.auth_token [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:35:25.882775 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: WARNING keystonemiddleware.auth_token [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:35:25.889529 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: WARNING keystonemiddleware.auth_token [None req-df0363d1-805a-48a5-a690-1f3ecb96553f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:35:25.896090 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5563209cf9c0 pid: 124122 (default app) Jun 02 13:35:25.992785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: WARNING keystonemiddleware.auth_token [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 13:35:25.998868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: WARNING keystonemiddleware.auth_token [None req-071b7815-9724-4656-ac1b-28731d786c35 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 13:35:26.005123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5563209cf9c0 pid: 124123 (default app) Jun 02 13:36:07.300891 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.301715 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.302657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.303402 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:08.633960 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b8e024d6-87da-4d90-898b-d635f26c3a66 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Action: 'create', calling method: .version_select at 0x7f8617024310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-513437298", "metadata": {"Type": "work"}}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b8e024d6-87da-4d90-898b-d635f26c3a66 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Request method failure captured: Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 121 Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzHFxgiUZa8ol31NfUgtKXiZie28LWVD-Q4d5mEJR3a0LU7MHvlP4G9e4d0mJZ6lio0P4x2tyKNKDXJj4Kf4KruI1X6CkGroe_HJR11MXmaDQnE6Z5OctjtOk9T2c0V8lIiaTaGaMLr07foaFgZd30ULtAHtX8i9eX5MwuYNqQHQQc Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:36:08.647219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/80d19e08e8794466b6ab5de018413367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_80d19e08e8794466b6ab5de018413367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}] Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 9a693f4cc3b14bb49bfc2d55b51a0741 Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-513437298", "metadata": {"Type": "work"}}} Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: Jun 02 13:36:08.648895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-513437298', 'metadata': {'Type': 'work'}}}} Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise error Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi '#$%' Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:36:08.649873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 13:36:08.651412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 13:36:08.652845 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 13:36:08.652845 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:08.652845 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b8e024d6-87da-4d90-898b-d635f26c3a66 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:36:08.654167 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b8e024d6-87da-4d90-898b-d635f26c3a66 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.358392 Jun 02 13:36:08.654888 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Jun 2 13:36:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1361 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:36:09.052113 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b28b8a0d-87db-4e1c-92a2-eb0648fb70f9 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Action: 'create', calling method: .version_select at 0x7f86170ba940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-481206391", "metadata": {"Type": "work"}}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b28b8a0d-87db-4e1c-92a2-eb0648fb70f9 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Request method failure captured: Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 119 Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzHFxgiUZa8ol31NfUgtKXiZie28LWVD-Q4d5mEJR3a0LU7MHvlP4G9e4d0mJZ6lio0P4x2tyKNKDXJj4Kf4KruI1X6CkGroe_HJR11MXmaDQnE6Z5OctjtOk9T2c0V8lIiaTaGaMLr07foaFgZd30ULtAHtX8i9eX5MwuYNqQHQQc Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:36:09.056961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/80d19e08e8794466b6ab5de018413367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_80d19e08e8794466b6ab5de018413367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}] Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 9a693f4cc3b14bb49bfc2d55b51a0741 Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-481206391", "metadata": {"Type": "work"}}} Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: Jun 02 13:36:09.058383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-481206391', 'metadata': {'Type': 'work'}}}} Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise error Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi '0' Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:36:09.059153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 13:36:09.060473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 13:36:09.061598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 13:36:09.061598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.061598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b28b8a0d-87db-4e1c-92a2-eb0648fb70f9 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:36:09.061598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b28b8a0d-87db-4e1c-92a2-eb0648fb70f9 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.397481 Jun 02 13:36:09.070252 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3b0e0f62-8096-4b4d-b920-0d7943d6a1f6 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Action: 'create', calling method: .version_select at 0x7f8616ec0670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1044906870", "metadata": {"Type": "work"}}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:09.071090 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 1/2] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Jun 2 13:36:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 411 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3b0e0f62-8096-4b4d-b920-0d7943d6a1f6 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Request method failure captured: Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 119 Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzHFxgiUZa8ol31NfUgtKXiZie28LWVD-Q4d5mEJR3a0LU7MHvlP4G9e4d0mJZ6lio0P4x2tyKNKDXJj4Kf4KruI1X6CkGroe_HJR11MXmaDQnE6Z5OctjtOk9T2c0V8lIiaTaGaMLr07foaFgZd30ULtAHtX8i9eX5MwuYNqQHQQc Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:36:09.073699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/80d19e08e8794466b6ab5de018413367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_80d19e08e8794466b6ab5de018413367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}] Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 9a693f4cc3b14bb49bfc2d55b51a0741 Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1044906870", "metadata": {"Type": "work"}}} Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: Jun 02 13:36:09.075494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1044906870', 'metadata': {'Type': 'work'}}}} Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise error Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi '' Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:36:09.076438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 13:36:09.077994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 13:36:09.079252 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 13:36:09.079252 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.079252 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3b0e0f62-8096-4b4d-b920-0d7943d6a1f6 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:36:09.081780 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3b0e0f62-8096-4b4d-b920-0d7943d6a1f6 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015673 Jun 02 13:36:09.082451 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 2/3] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Jun 2 13:36:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 02 13:36:09.093057 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0e7c5d86-25a7-40b7-a0fb-c1259b5b33c8 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Calling method '.version_select at 0x7f8616f0b310>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:09.153590 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:09.156994 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:09.157929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:09.158740 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:09.762736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-0e7c5d86-25a7-40b7-a0fb-c1259b5b33c8 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] HTTP exception thrown: Volume tempest-invalid-512635467 could not be found. Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0e7c5d86-25a7-40b7-a0fb-c1259b5b33c8 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Request method failure captured: Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-512635467 HTTP/1.1 Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzHFxgiUZa8ol31NfUgtKXiZie28LWVD-Q4d5mEJR3a0LU7MHvlP4G9e4d0mJZ6lio0P4x2tyKNKDXJj4Kf4KruI1X6CkGroe_HJR11MXmaDQnE6Z5OctjtOk9T2c0V8lIiaTaGaMLr07foaFgZd30ULtAHtX8i9eX5MwuYNqQHQQc Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:36:09.769150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/80d19e08e8794466b6ab5de018413367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_80d19e08e8794466b6ab5de018413367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}] Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 9a693f4cc3b14bb49bfc2d55b51a0741 Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Volume tempest-invalid-512635467 could not be found. Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'tempest-invalid-512635467'} Jun 02 13:36:09.770575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-512635467 could not be found. (HTTP 404) (Request-ID: req-bce5b66b-e096-4292-b15f-210f6b6fefb5) Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:09.771380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:36:09.777734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-512635467 could not be found. Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:36:09.779174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-512635467 could not be found. Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-512635467 could not be found. Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0e7c5d86-25a7-40b7-a0fb-c1259b5b33c8 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Returning 404 to user: Volume tempest-invalid-512635467 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0e7c5d86-25a7-40b7-a0fb-c1259b5b33c8 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-512635467" status: 404 len: 98 microversion: 2.1 time: 0.681954 Jun 02 13:36:09.780672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1214 bytes} [Thu Jun 2 13:36:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-512635467 => generated 98 bytes in 684 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 02 13:36:09.788506 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f011eb9d-4713-410d-b3a2-93037c9a1ed4 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003885 Jun 02 13:36:09.788506 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 3/5] 10.222.0.32 () {58 vars in 1139 bytes} [Thu Jun 2 13:36:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 02 13:36:09.791506 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1a6a23c7-b125-445f-86bf-2f0aede93d96 tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004409 Jun 02 13:36:09.795888 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 3/6] 10.222.0.32 () {58 vars in 1136 bytes} [Thu Jun 2 13:36:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 13:36:09.801276 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9d72bfaf-15ea-444e-810c-903dc4c17ebd tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Calling method '.version_select at 0x7f86170deca0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:10.073141 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-9d72bfaf-15ea-444e-810c-903dc4c17ebd tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] HTTP exception thrown: Volume 9e2f4201-6db0-4cca-a378-b2cf3496bc73 could not be found. Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9d72bfaf-15ea-444e-810c-903dc4c17ebd tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Request method failure captured: Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/os-volumes/9e2f4201-6db0-4cca-a378-b2cf3496bc73 HTTP/1.1 Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzHFxgiUZa8ol31NfUgtKXiZie28LWVD-Q4d5mEJR3a0LU7MHvlP4G9e4d0mJZ6lio0P4x2tyKNKDXJj4Kf4KruI1X6CkGroe_HJR11MXmaDQnE6Z5OctjtOk9T2c0V8lIiaTaGaMLr07foaFgZd30ULtAHtX8i9eX5MwuYNqQHQQc Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:36:10.078459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/80d19e08e8794466b6ab5de018413367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_80d19e08e8794466b6ab5de018413367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}] Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 9a693f4cc3b14bb49bfc2d55b51a0741 Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Volume 9e2f4201-6db0-4cca-a378-b2cf3496bc73 could not be found. Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '9e2f4201-6db0-4cca-a378-b2cf3496bc73'} Jun 02 13:36:10.080147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e2f4201-6db0-4cca-a378-b2cf3496bc73 could not be found. (HTTP 404) (Request-ID: req-70a2b048-2359-4670-829b-8d19a4007a60) Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:10.081310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:36:10.082618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e2f4201-6db0-4cca-a378-b2cf3496bc73 could not be found. Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 13:36:10.083887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e2f4201-6db0-4cca-a378-b2cf3496bc73 could not be found. Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e2f4201-6db0-4cca-a378-b2cf3496bc73 could not be found. Jun 02 13:36:10.087127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.089642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9d72bfaf-15ea-444e-810c-903dc4c17ebd tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Returning 404 to user: Volume 9e2f4201-6db0-4cca-a378-b2cf3496bc73 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:36:10.090689 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9d72bfaf-15ea-444e-810c-903dc4c17ebd tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/9e2f4201-6db0-4cca-a378-b2cf3496bc73" status: 404 len: 109 microversion: 2.1 time: 0.293190 Jun 02 13:36:10.092331 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Jun 2 13:36:09 2022] DELETE /compute/v2.1/os-volumes/9e2f4201-6db0-4cca-a378-b2cf3496bc73 => generated 109 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:36:10.102485 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-242fe20d-4367-4f92-9ff9-e00833f9cb3f tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Calling method '.version_select at 0x7f8616e4cdc0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:10.154613 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-242fe20d-4367-4f92-9ff9-e00833f9cb3f tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] HTTP exception thrown: Volume cc68aa7a-f349-4d98-9114-6662aad76552 could not be found. Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-242fe20d-4367-4f92-9ff9-e00833f9cb3f tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Request method failure captured: Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/os-volumes/cc68aa7a-f349-4d98-9114-6662aad76552 HTTP/1.1 Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzHFxgiUZa8ol31NfUgtKXiZie28LWVD-Q4d5mEJR3a0LU7MHvlP4G9e4d0mJZ6lio0P4x2tyKNKDXJj4Kf4KruI1X6CkGroe_HJR11MXmaDQnE6Z5OctjtOk9T2c0V8lIiaTaGaMLr07foaFgZd30ULtAHtX8i9eX5MwuYNqQHQQc Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:36:10.157167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/80d19e08e8794466b6ab5de018413367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_80d19e08e8794466b6ab5de018413367"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/80d19e08e8794466b6ab5de018413367"}]}] Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 80d19e08e8794466b6ab5de018413367 Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesNegativeTest-1165313997 Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 9a693f4cc3b14bb49bfc2d55b51a0741 Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesNegativeTest-1165313997-project Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Volume cc68aa7a-f349-4d98-9114-6662aad76552 could not be found. Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'cc68aa7a-f349-4d98-9114-6662aad76552'} Jun 02 13:36:10.158461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cc68aa7a-f349-4d98-9114-6662aad76552 could not be found. (HTTP 404) (Request-ID: req-3b9bb421-4aed-49a6-88f6-943ed6c5b377) Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:10.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:36:10.160824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cc68aa7a-f349-4d98-9114-6662aad76552 could not be found. Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 13:36:10.161929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cc68aa7a-f349-4d98-9114-6662aad76552 could not be found. Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cc68aa7a-f349-4d98-9114-6662aad76552 could not be found. Jun 02 13:36:10.163100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:36:10.166974 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-242fe20d-4367-4f92-9ff9-e00833f9cb3f tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] Returning 404 to user: Volume cc68aa7a-f349-4d98-9114-6662aad76552 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:36:10.168043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-242fe20d-4367-4f92-9ff9-e00833f9cb3f tempest-VolumesNegativeTest-1165313997 tempest-VolumesNegativeTest-1165313997-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/cc68aa7a-f349-4d98-9114-6662aad76552" status: 404 len: 109 microversion: 2.1 time: 0.070012 Jun 02 13:36:10.169406 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:36:10 2022] GET /compute/v2.1/os-volumes/cc68aa7a-f349-4d98-9114-6662aad76552 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:36:12.056158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-326119620", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "networks": [{"uuid": "4348bfd1-86a2-4589-9eb3-58bf24def491"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:12.222998 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] validate_networks() for [('4348bfd1-86a2-4589-9eb3-58bf24def491', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:36:15.355795 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:36:15.356475 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:36:15.357143 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:36:15.357696 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:36:15.358219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:36:15.391069 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:15.394670 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:15.395639 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:15.396926 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:15.494614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Getting quotas for project 28aead0a91684b0eb7fcdeace101cd1b. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:15.519649 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Getting quotas for user 24621111433b47458b429fb7cd862b18 and project 28aead0a91684b0eb7fcdeace101cd1b. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:15.550057 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:36:15.553802 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:36:15.763283 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-39ed3dd8-df15-47e6-970f-85bcd7d378d8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.998569 Jun 02 13:36:15.765058 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 5/9] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:36:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 4001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:36:15.777692 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-21fe05fa-e88f-4642-92c0-6c5685d366e7 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:15.778455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-21fe05fa-e88f-4642-92c0-6c5685d366e7 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:16.599987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-21fe05fa-e88f-4642-92c0-6c5685d366e7 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:16.616661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-21fe05fa-e88f-4642-92c0-6c5685d366e7 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1214 microversion: 2.1 time: 0.843895 Jun 02 13:36:16.618876 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 5/10] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:15 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1214 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:17.636709 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2373ca8a-2290-4e65-9ae6-0c65b9e99f0c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:17.637474 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2373ca8a-2290-4e65-9ae6-0c65b9e99f0c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:17.855270 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2373ca8a-2290-4e65-9ae6-0c65b9e99f0c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:17.885377 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2373ca8a-2290-4e65-9ae6-0c65b9e99f0c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1214 microversion: 2.1 time: 0.252481 Jun 02 13:36:17.887034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 6/11] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:17 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:18.903215 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-67824cf2-0d1c-4305-93b8-27f32e2ac995 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:18.904991 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-67824cf2-0d1c-4305-93b8-27f32e2ac995 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:18.916879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67824cf2-0d1c-4305-93b8-27f32e2ac995 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:18.927383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67824cf2-0d1c-4305-93b8-27f32e2ac995 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:18.933289 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67824cf2-0d1c-4305-93b8-27f32e2ac995 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:18.934100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67824cf2-0d1c-4305-93b8-27f32e2ac995 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:19.307402 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-67824cf2-0d1c-4305-93b8-27f32e2ac995 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:19.329246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-67824cf2-0d1c-4305-93b8-27f32e2ac995 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1218 microversion: 2.1 time: 0.429629 Jun 02 13:36:19.333111 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:18 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1218 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:19.569187 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-247538322", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:19.680583 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] validate_networks() for [('f3b71a2c-b260-4c3e-88e4-93261c3bf9d1', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:36:20.349854 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f2779c17-cc18-43ec-8933-a8090ced18f6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:20.350746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f2779c17-cc18-43ec-8933-a8090ced18f6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:20.373458 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2779c17-cc18-43ec-8933-a8090ced18f6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:20.377118 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2779c17-cc18-43ec-8933-a8090ced18f6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:20.378150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2779c17-cc18-43ec-8933-a8090ced18f6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:20.378760 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2779c17-cc18-43ec-8933-a8090ced18f6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:20.830005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f2779c17-cc18-43ec-8933-a8090ced18f6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:20.847838 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f2779c17-cc18-43ec-8933-a8090ced18f6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1218 microversion: 2.1 time: 0.504328 Jun 02 13:36:20.854200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:20 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1218 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:21.143090 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a61da786-98ff-410d-b90d-143ed5ffdc0d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: .version_select at 0x7f8616d41280>, body: {"keypair": {"name": "tempest-keypair-2127387470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5GhlYCNAmxxGAOI83HaLoqocSnqBHla9ZLakckK6K6WKgRjw+kJP4szzaElXA6zNUfDuhUGLONLIFNNtn3rckZBE5Gzw78AkpQVHgYmkvUO3baMyznnouE9S4BxI5CSQ=="}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:21.236633 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-a61da786-98ff-410d-b90d-143ed5ffdc0d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:21.252768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-a61da786-98ff-410d-b90d-143ed5ffdc0d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for user a1622acb057f419ca98e7d44584c276d and project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:21.369135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a61da786-98ff-410d-b90d-143ed5ffdc0d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.511575 Jun 02 13:36:21.370564 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 8/14] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Jun 2 13:36:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:21.876499 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-45f67e5f-e9bf-46d1-b98b-22b47b4546f8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:21.880208 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-45f67e5f-e9bf-46d1-b98b-22b47b4546f8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:21.900076 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45f67e5f-e9bf-46d1-b98b-22b47b4546f8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:21.916963 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45f67e5f-e9bf-46d1-b98b-22b47b4546f8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:21.918019 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45f67e5f-e9bf-46d1-b98b-22b47b4546f8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:21.922825 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45f67e5f-e9bf-46d1-b98b-22b47b4546f8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:21.982614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:36:21.983376 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:36:21.983941 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:36:21.984393 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:36:21.987437 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:36:22.029216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:22.029676 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:22.030493 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:22.030934 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:22.077222 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Getting quotas for project ff89a4ee01d444d2aee3bdc9199d556f. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:22.084440 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Getting quotas for user b92da35ea7c946ea876b13b13ed98258 and project ff89a4ee01d444d2aee3bdc9199d556f. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:22.119776 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:36:22.130371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:36:22.235026 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-eb0d0319-d338-4d91-9c35-5e0c61e77d8f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.253881 Jun 02 13:36:22.246614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 7/15] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:36:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:36:22.252748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8f4c0996-4753-46cf-b7ed-401006e37274 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:22.254065 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8f4c0996-4753-46cf-b7ed-401006e37274 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:22.438563 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-45f67e5f-e9bf-46d1-b98b-22b47b4546f8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:22.475899 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-45f67e5f-e9bf-46d1-b98b-22b47b4546f8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1266 microversion: 2.1 time: 0.596866 Jun 02 13:36:22.479961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 9/16] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:21 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1266 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:22.524105 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8f4c0996-4753-46cf-b7ed-401006e37274 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:22.532146 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8f4c0996-4753-46cf-b7ed-401006e37274 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1221 microversion: 2.1 time: 0.284111 Jun 02 13:36:22.537510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 8/17] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:22 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1221 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:22.810301 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-930254409", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:23.007079 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] validate_networks() for [('f3b71a2c-b260-4c3e-88e4-93261c3bf9d1', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:36:23.494781 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2efea165-3161-4da1-b91d-e652fe04b571 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:23.496233 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2efea165-3161-4da1-b91d-e652fe04b571 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:23.518167 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2efea165-3161-4da1-b91d-e652fe04b571 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:23.520292 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2efea165-3161-4da1-b91d-e652fe04b571 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:23.521329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2efea165-3161-4da1-b91d-e652fe04b571 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:23.523850 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2efea165-3161-4da1-b91d-e652fe04b571 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:23.975322 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2efea165-3161-4da1-b91d-e652fe04b571 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:23.998978 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2efea165-3161-4da1-b91d-e652fe04b571 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1274 microversion: 2.1 time: 0.507989 Jun 02 13:36:24.011117 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 9/18] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:23 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1274 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:25.019761 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-48cca554-5cef-4a49-a4b2-f02fa0138869 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:25.021346 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-48cca554-5cef-4a49-a4b2-f02fa0138869 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:25.042314 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48cca554-5cef-4a49-a4b2-f02fa0138869 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:25.044088 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48cca554-5cef-4a49-a4b2-f02fa0138869 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:25.046106 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48cca554-5cef-4a49-a4b2-f02fa0138869 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:25.048063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48cca554-5cef-4a49-a4b2-f02fa0138869 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:25.473100 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-48cca554-5cef-4a49-a4b2-f02fa0138869 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:25.489406 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-48cca554-5cef-4a49-a4b2-f02fa0138869 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1272 microversion: 2.1 time: 0.473913 Jun 02 13:36:25.490360 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 10/19] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:25 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1272 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:26.327391 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:36:26.328774 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:36:26.329522 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:36:26.330264 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:36:26.331162 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:36:26.342246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:26.343019 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:26.345018 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:26.345767 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:26.379825 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Getting quotas for project ff89a4ee01d444d2aee3bdc9199d556f. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:26.384823 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Getting quotas for user b92da35ea7c946ea876b13b13ed98258 and project ff89a4ee01d444d2aee3bdc9199d556f. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:26.466008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:36:26.469800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:36:26.508039 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-99b49b36-4fc4-4d65-a81c-3a7d1c4a8612 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:26.508867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-99b49b36-4fc4-4d65-a81c-3a7d1c4a8612 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:26.520183 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99b49b36-4fc4-4d65-a81c-3a7d1c4a8612 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:26.525093 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99b49b36-4fc4-4d65-a81c-3a7d1c4a8612 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:26.533463 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99b49b36-4fc4-4d65-a81c-3a7d1c4a8612 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:26.534197 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99b49b36-4fc4-4d65-a81c-3a7d1c4a8612 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:26.639743 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-09512ecd-573e-4ba9-976c-d502be8e829c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.835650 Jun 02 13:36:26.646377 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 10/20] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:36:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 3843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:36:26.666312 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e3ae6292-1660-493f-8a33-37931e472b4d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:26.669477 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e3ae6292-1660-493f-8a33-37931e472b4d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:26.933199 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-99b49b36-4fc4-4d65-a81c-3a7d1c4a8612 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:26.942075 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-99b49b36-4fc4-4d65-a81c-3a7d1c4a8612 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1272 microversion: 2.1 time: 0.438553 Jun 02 13:36:26.946553 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 11/21] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:26 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1272 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:26.969936 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e3ae6292-1660-493f-8a33-37931e472b4d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:26.977866 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e3ae6292-1660-493f-8a33-37931e472b4d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1221 microversion: 2.1 time: 0.324496 Jun 02 13:36:26.983726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 11/22] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:26 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1221 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:27.451440 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3e1a30a3-ca30-4c4c-8f62-0ed2f7174532 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Action: 'create', calling method: .version_select at 0x7f8615cba8b0>, body: {"keypair": {"name": "tempest-keypair-1902643147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzT2bIDMI0niqG0H1M0Cm8fujFfjiju5d2F28zaDeYPpZ249Jk+nSdBTYgHaRPYL/xBnpq8r4N07jNBRo/EleNM9QUpLz/KvkNgtnhx/LFBeRp3uctAgb6w0hxiaG/egw=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:27.497999 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-3e1a30a3-ca30-4c4c-8f62-0ed2f7174532 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Getting quotas for project 8e9e2d5c93274eb781bd76912178bae6. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:27.503295 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-3e1a30a3-ca30-4c4c-8f62-0ed2f7174532 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Getting quotas for user 88bc03c141d64772b606e087d86e973e and project 8e9e2d5c93274eb781bd76912178bae6. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:27.560986 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3e1a30a3-ca30-4c4c-8f62-0ed2f7174532 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.178378 Jun 02 13:36:27.562712 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 12/23] 10.222.0.32 () {62 vars in 1199 bytes} [Thu Jun 2 13:36:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:27.964358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d8f194ec-c8cd-4277-b624-f8b8bbd00cec tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:27.965280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d8f194ec-c8cd-4277-b624-f8b8bbd00cec tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:27.978341 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8f194ec-c8cd-4277-b624-f8b8bbd00cec tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:27.979051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8f194ec-c8cd-4277-b624-f8b8bbd00cec tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:27.982157 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8f194ec-c8cd-4277-b624-f8b8bbd00cec tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:27.982839 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8f194ec-c8cd-4277-b624-f8b8bbd00cec tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:28.004961 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-840eca72-7302-4a70-be59-e824feeb699e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:28.006096 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-840eca72-7302-4a70-be59-e824feeb699e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:28.028725 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-840eca72-7302-4a70-be59-e824feeb699e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:28.032028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-840eca72-7302-4a70-be59-e824feeb699e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:28.034381 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-840eca72-7302-4a70-be59-e824feeb699e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:28.037721 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-840eca72-7302-4a70-be59-e824feeb699e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:28.686585 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-840eca72-7302-4a70-be59-e824feeb699e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:28.701267 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-840eca72-7302-4a70-be59-e824feeb699e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1225 microversion: 2.1 time: 0.701228 Jun 02 13:36:28.701852 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 13/24] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:27 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1225 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:29.023388 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-88091458-b03b-459d-a23f-a9036faca1ad tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'create', calling method: .version_select at 0x7f8615c5ed30>, body: {"keypair": {"name": "tempest-keypair-322418662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3kJjodD+vOrCS/SrSI7S3xSCh2zFxd3xOj0BPkSBOwaFlS/eA7gpcZkvyBdNUmV3UIcJiTvbLgcCcZUiVNXZJzgG9MR7R56aT8STddAR0POoSssVx3milCJ7JcOKJ0aA=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:29.103276 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-88091458-b03b-459d-a23f-a9036faca1ad tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Getting quotas for project 39255fa001f44b29a23006adf9c1a10d. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:29.126863 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-88091458-b03b-459d-a23f-a9036faca1ad tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Getting quotas for user 4e88422338024035b5c64d2788965086 and project 39255fa001f44b29a23006adf9c1a10d. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:29.268220 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-88091458-b03b-459d-a23f-a9036faca1ad tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.560967 Jun 02 13:36:29.271891 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 14/25] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Jun 2 13:36:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:29.341540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-626472490", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dbc7e40-4f9d-4008-913e-157e6f3d947d"}], "security_groups": [{"name": "tempest-securitygroup--1246590967"}], "key_name": "tempest-keypair-2127387470", "user_data": "}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:29.738402 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d8f194ec-c8cd-4277-b624-f8b8bbd00cec tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:29.748078 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d8f194ec-c8cd-4277-b624-f8b8bbd00cec tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 1.788815 Jun 02 13:36:29.753465 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 12/26] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:27 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:29.765902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-02aee094-f3f6-4aa0-a806-b22584dd10f6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:29.767403 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-02aee094-f3f6-4aa0-a806-b22584dd10f6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:29.794020 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-02aee094-f3f6-4aa0-a806-b22584dd10f6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:29.797752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-02aee094-f3f6-4aa0-a806-b22584dd10f6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:29.799694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-02aee094-f3f6-4aa0-a806-b22584dd10f6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:29.800796 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-02aee094-f3f6-4aa0-a806-b22584dd10f6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:30.087284 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-02aee094-f3f6-4aa0-a806-b22584dd10f6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:30.104745 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-02aee094-f3f6-4aa0-a806-b22584dd10f6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1281 microversion: 2.1 time: 0.349872 Jun 02 13:36:30.107706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 13/27] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:29 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1281 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:30.219889 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] validate_networks() for [('4dbc7e40-4f9d-4008-913e-157e6f3d947d', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:36:30.773193 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-045d6bf1-0bd6-49ef-aba9-6bc37f7b3739 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:30.774206 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-045d6bf1-0bd6-49ef-aba9-6bc37f7b3739 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:30.794539 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-045d6bf1-0bd6-49ef-aba9-6bc37f7b3739 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:30.795455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-045d6bf1-0bd6-49ef-aba9-6bc37f7b3739 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:30.797935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-045d6bf1-0bd6-49ef-aba9-6bc37f7b3739 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:30.799785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-045d6bf1-0bd6-49ef-aba9-6bc37f7b3739 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:32.049758 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=4 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:32.324853 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-045d6bf1-0bd6-49ef-aba9-6bc37f7b3739 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:32.339632 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-045d6bf1-0bd6-49ef-aba9-6bc37f7b3739 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 1.568523 Jun 02 13:36:32.340950 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 14/28] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:30 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:32.352054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d6045cb3-7163-4268-b58f-9cb84eee7470 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:32.355617 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d6045cb3-7163-4268-b58f-9cb84eee7470 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:32.371401 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6045cb3-7163-4268-b58f-9cb84eee7470 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:32.374799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6045cb3-7163-4268-b58f-9cb84eee7470 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:32.375868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6045cb3-7163-4268-b58f-9cb84eee7470 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:32.379356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6045cb3-7163-4268-b58f-9cb84eee7470 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:32.642740 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d6045cb3-7163-4268-b58f-9cb84eee7470 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:32.655067 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d6045cb3-7163-4268-b58f-9cb84eee7470 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1279 microversion: 2.1 time: 0.312716 Jun 02 13:36:32.673742 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 15/29] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:32 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1279 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:33.358331 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c91ba37f-8662-4719-aa57-45027e60adea tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:33.359024 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c91ba37f-8662-4719-aa57-45027e60adea tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:33.375137 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c91ba37f-8662-4719-aa57-45027e60adea tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:33.375618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c91ba37f-8662-4719-aa57-45027e60adea tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:33.376455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c91ba37f-8662-4719-aa57-45027e60adea tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:33.383456 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c91ba37f-8662-4719-aa57-45027e60adea tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:33.901194 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c91ba37f-8662-4719-aa57-45027e60adea tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:33.909819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c91ba37f-8662-4719-aa57-45027e60adea tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 0.555865 Jun 02 13:36:33.913808 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 16/30] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:33 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:33.920692 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6d79568f-2672-45fe-905f-342e971c93fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:33.921930 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6d79568f-2672-45fe-905f-342e971c93fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:33.930777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d79568f-2672-45fe-905f-342e971c93fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:33.931426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d79568f-2672-45fe-905f-342e971c93fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:33.932950 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d79568f-2672-45fe-905f-342e971c93fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:33.933664 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d79568f-2672-45fe-905f-342e971c93fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:34.494802 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6d79568f-2672-45fe-905f-342e971c93fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:34.509389 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6d79568f-2672-45fe-905f-342e971c93fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1279 microversion: 2.1 time: 0.594191 Jun 02 13:36:34.517898 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 17/31] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:33 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1279 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:34.930399 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b298b3a5-e2ed-407c-b10a-44a3cab756c1 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:34.931009 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b298b3a5-e2ed-407c-b10a-44a3cab756c1 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:34.964198 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b298b3a5-e2ed-407c-b10a-44a3cab756c1 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:34.964685 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b298b3a5-e2ed-407c-b10a-44a3cab756c1 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:34.976286 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b298b3a5-e2ed-407c-b10a-44a3cab756c1 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:34.976778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b298b3a5-e2ed-407c-b10a-44a3cab756c1 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:35.181754 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:36:35.182937 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:36:35.183572 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:36:35.187178 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:36:35.187858 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:36:35.211178 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:35.213481 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:35.214495 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:35.219672 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:35.303472 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:35.313994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for user a1622acb057f419ca98e7d44584c276d and project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:35.345626 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:36:35.372909 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:36:35.493694 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9562539f-7db1-4bcc-a80d-211f0b465cd4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.206765 Jun 02 13:36:35.506181 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 15/32] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:36:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 6221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:36:35.522291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6d1c160c-e343-4db8-b6ab-82317c8c5e25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:35.524374 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6d1c160c-e343-4db8-b6ab-82317c8c5e25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:35.825164 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6d1c160c-e343-4db8-b6ab-82317c8c5e25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:35.838432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6d1c160c-e343-4db8-b6ab-82317c8c5e25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1241 microversion: 2.1 time: 0.330371 Jun 02 13:36:35.839535 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 16/33] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:35 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1241 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:35.854682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-657e1ae9-fba3-4b71-9881-90769a81c0e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:35.858894 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-657e1ae9-fba3-4b71-9881-90769a81c0e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:35.886248 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-657e1ae9-fba3-4b71-9881-90769a81c0e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:35.890314 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-657e1ae9-fba3-4b71-9881-90769a81c0e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:35.891258 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-657e1ae9-fba3-4b71-9881-90769a81c0e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:35.893520 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-657e1ae9-fba3-4b71-9881-90769a81c0e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:36.367570 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:36.897689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b298b3a5-e2ed-407c-b10a-44a3cab756c1 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:36.912216 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b298b3a5-e2ed-407c-b10a-44a3cab756c1 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 1.985905 Jun 02 13:36:36.927427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 18/34] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:34 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:36.977311 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=14 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:37.572135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-9df7c4ee-3c1c-4007-b186-6d258c20fa27 req-f34e6a67-cf92-46b4-9b7e-200cab67d7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26b39de5-4a0e-4232-840a-69b48be6b336", "tag": "5cea31d6-3312-484a-b0a9-2d3fedd84f23"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:37.627710 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-9df7c4ee-3c1c-4007-b186-6d258c20fa27 req-f34e6a67-cf92-46b4-9b7e-200cab67d7a3 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:37.628549 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-9df7c4ee-3c1c-4007-b186-6d258c20fa27 req-f34e6a67-cf92-46b4-9b7e-200cab67d7a3 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:37.698789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-9df7c4ee-3c1c-4007-b186-6d258c20fa27 req-f34e6a67-cf92-46b4-9b7e-200cab67d7a3 service nova] Creating event network-changed:5cea31d6-3312-484a-b0a9-2d3fedd84f23 for instance 26b39de5-4a0e-4232-840a-69b48be6b336 on hv-cinder-83608 Jun 02 13:36:37.701379 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-9df7c4ee-3c1c-4007-b186-6d258c20fa27 req-f34e6a67-cf92-46b4-9b7e-200cab67d7a3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 13:36:37.714706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c124ae6-cc94-434b-8c28-c91ccd0e1f1e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:37.715546 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c124ae6-cc94-434b-8c28-c91ccd0e1f1e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:37.716505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c124ae6-cc94-434b-8c28-c91ccd0e1f1e None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:37.716961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c124ae6-cc94-434b-8c28-c91ccd0e1f1e None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:37.737830 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.compute.rpcapi [None req-4c124ae6-cc94-434b-8c28-c91ccd0e1f1e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 13:36:37.740874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c124ae6-cc94-434b-8c28-c91ccd0e1f1e None None] Releasing lock "compute-rpcapi-router" {{(pid=124123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 13:36:37.792524 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4c124ae6-cc94-434b-8c28-c91ccd0e1f1e None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.857005 Jun 02 13:36:37.795059 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 19/35] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:37.807128 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-01cb499d-7e6b-4788-8ce6-d7ac626a5208 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:37.809452 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-01cb499d-7e6b-4788-8ce6-d7ac626a5208 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:37.824112 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01cb499d-7e6b-4788-8ce6-d7ac626a5208 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:37.826244 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01cb499d-7e6b-4788-8ce6-d7ac626a5208 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:37.841608 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01cb499d-7e6b-4788-8ce6-d7ac626a5208 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:37.845175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01cb499d-7e6b-4788-8ce6-d7ac626a5208 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:38.591296 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-657e1ae9-fba3-4b71-9881-90769a81c0e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:38.593734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-01cb499d-7e6b-4788-8ce6-d7ac626a5208 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:38.598138 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=35 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.609579 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-657e1ae9-fba3-4b71-9881-90769a81c0e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 2.760461 Jun 02 13:36:38.614105 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 17/36] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:35 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 2771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:38.622630 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-01cb499d-7e6b-4788-8ce6-d7ac626a5208 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1293 microversion: 2.1 time: 0.824842 Jun 02 13:36:38.637918 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1ac82780-3ee5-4866-8fe8-f401e4b59ab2 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:38.638935 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1ac82780-3ee5-4866-8fe8-f401e4b59ab2 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:38.646482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 20/37] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:37 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1293 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:38.656771 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=11 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.668463 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ac82780-3ee5-4866-8fe8-f401e4b59ab2 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:38.669044 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ac82780-3ee5-4866-8fe8-f401e4b59ab2 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:38.669899 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ac82780-3ee5-4866-8fe8-f401e4b59ab2 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:38.670352 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ac82780-3ee5-4866-8fe8-f401e4b59ab2 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:39.299574 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1729379508", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb683ea3-68dc-4328-b475-e935cfb92acc"}], "security_groups": [{"name": "tempest-securitygroup--1457316948"}], "key_name": "tempest-keypair-322418662", "user_data": "}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:39.314936 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:39.696608 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1ac82780-3ee5-4866-8fe8-f401e4b59ab2 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:39.704061 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1ac82780-3ee5-4866-8fe8-f401e4b59ab2 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 1.088982 Jun 02 13:36:39.704666 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 18/38] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:38 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:39.724641 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2453d536-067b-476c-8f36-241eb8f56d70 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:39.725272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2453d536-067b-476c-8f36-241eb8f56d70 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:39.751653 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2453d536-067b-476c-8f36-241eb8f56d70 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:39.752284 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2453d536-067b-476c-8f36-241eb8f56d70 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:39.753224 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2453d536-067b-476c-8f36-241eb8f56d70 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:39.754292 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2453d536-067b-476c-8f36-241eb8f56d70 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:39.772871 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] validate_networks() for [('cb683ea3-68dc-4328-b475-e935cfb92acc', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:36:40.168786 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2453d536-067b-476c-8f36-241eb8f56d70 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:40.178674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2453d536-067b-476c-8f36-241eb8f56d70 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.457711 Jun 02 13:36:40.179689 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 19/39] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:39 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:40.188839 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-73a8a777-15df-4b6d-ab3a-095c9b55f781 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:40.189748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-73a8a777-15df-4b6d-ab3a-095c9b55f781 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:40.202319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73a8a777-15df-4b6d-ab3a-095c9b55f781 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:40.203043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73a8a777-15df-4b6d-ab3a-095c9b55f781 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:40.204100 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73a8a777-15df-4b6d-ab3a-095c9b55f781 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:40.204640 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73a8a777-15df-4b6d-ab3a-095c9b55f781 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:40.795942 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-73a8a777-15df-4b6d-ab3a-095c9b55f781 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:40.804521 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-73a8a777-15df-4b6d-ab3a-095c9b55f781 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1299 microversion: 2.1 time: 0.621448 Jun 02 13:36:40.805788 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 20/40] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:40 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1299 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:40.821705 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-749227353", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20bf99c3-c1f6-40c9-b149-35408e01ced9"}], "security_groups": [{"name": "tempest-securitygroup--1087117269"}], "key_name": "tempest-keypair-1902643147", "user_data": "}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:41.074288 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] validate_networks() for [('20bf99c3-c1f6-40c9-b149-35408e01ced9', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:36:41.298159 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:36:41.298750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:36:41.299056 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:36:41.299474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:36:41.299896 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:36:41.316473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:41.316794 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:41.317614 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:41.318061 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:41.326516 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=73 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:41.370595 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Getting quotas for project 39255fa001f44b29a23006adf9c1a10d. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:41.375654 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Getting quotas for user 4e88422338024035b5c64d2788965086 and project 39255fa001f44b29a23006adf9c1a10d. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:41.415541 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:36:41.423756 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:36:41.536545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ad735531-e4ed-4d72-a3a5-8e83a4104d4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.241726 Jun 02 13:36:41.539825 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 21/41] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:36:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:36:41.555241 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-615d6535-8fad-47a4-a7b2-169f025d04ef tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:41.558595 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-615d6535-8fad-47a4-a7b2-169f025d04ef tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:41.574839 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-615d6535-8fad-47a4-a7b2-169f025d04ef tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:41.588998 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-615d6535-8fad-47a4-a7b2-169f025d04ef tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:41.590262 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-615d6535-8fad-47a4-a7b2-169f025d04ef tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:41.591262 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-615d6535-8fad-47a4-a7b2-169f025d04ef tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:42.822894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-615d6535-8fad-47a4-a7b2-169f025d04ef tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:42.847987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-615d6535-8fad-47a4-a7b2-169f025d04ef tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 1.306660 Jun 02 13:36:42.849138 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 22/42] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:41 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:42.860320 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3e2c4418-43b7-4545-a420-964b11bc2c4a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:42.862511 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3e2c4418-43b7-4545-a420-964b11bc2c4a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:42.883874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3e2c4418-43b7-4545-a420-964b11bc2c4a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:42.889639 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3e2c4418-43b7-4545-a420-964b11bc2c4a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:42.890541 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3e2c4418-43b7-4545-a420-964b11bc2c4a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:42.891287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3e2c4418-43b7-4545-a420-964b11bc2c4a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:43.691677 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3e2c4418-43b7-4545-a420-964b11bc2c4a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:43.704791 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3e2c4418-43b7-4545-a420-964b11bc2c4a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.846937 Jun 02 13:36:43.716780 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 23/43] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:42 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:43.723002 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3494b477-cf29-400c-9e38-f713233e0142 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:43.723766 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3494b477-cf29-400c-9e38-f713233e0142 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:43.732204 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3494b477-cf29-400c-9e38-f713233e0142 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:43.732861 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3494b477-cf29-400c-9e38-f713233e0142 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:43.733944 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3494b477-cf29-400c-9e38-f713233e0142 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:43.734527 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3494b477-cf29-400c-9e38-f713233e0142 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:43.758725 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:36:43.759282 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:36:43.759630 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:36:43.760476 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:36:43.761072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:36:43.768792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=33 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:43.788980 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:43.790000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:43.791685 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:43.792282 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:43.826908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Getting quotas for project 8e9e2d5c93274eb781bd76912178bae6. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:36:43.831612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Getting quotas for user 88bc03c141d64772b606e087d86e973e and project 8e9e2d5c93274eb781bd76912178bae6. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:36:43.849411 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:36:43.852168 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:36:43.930391 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-77a92601-835f-450e-94f2-e316f9ba336d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.121371 Jun 02 13:36:43.931428 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 21/44] 10.222.0.32 () {62 vars in 1187 bytes} [Thu Jun 2 13:36:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 3125 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 13:36:43.947513 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d126b3c2-918f-4c63-a9ec-9395cd21bb06 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:43.953381 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d126b3c2-918f-4c63-a9ec-9395cd21bb06 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:43.965260 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d126b3c2-918f-4c63-a9ec-9395cd21bb06 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:43.967072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d126b3c2-918f-4c63-a9ec-9395cd21bb06 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:43.968040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d126b3c2-918f-4c63-a9ec-9395cd21bb06 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:43.968870 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d126b3c2-918f-4c63-a9ec-9395cd21bb06 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:44.024499 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3494b477-cf29-400c-9e38-f713233e0142 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:44.044180 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3494b477-cf29-400c-9e38-f713233e0142 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1289 microversion: 2.1 time: 0.324315 Jun 02 13:36:44.047129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 24/45] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:43 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1289 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:44.567225 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-a8976873-b01f-4511-a01d-efe7ff5083c1 req-9a51d1df-5988-41e4-bb14-d4b3744783c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82cda25-d51b-490e-9102-3de1f9b9066b", "tag": "d47c6ac3-a0dd-453a-a639-2012303e854a"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:44.605447 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-a8976873-b01f-4511-a01d-efe7ff5083c1 req-9a51d1df-5988-41e4-bb14-d4b3744783c4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:44.607332 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-a8976873-b01f-4511-a01d-efe7ff5083c1 req-9a51d1df-5988-41e4-bb14-d4b3744783c4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:44.643545 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d126b3c2-918f-4c63-a9ec-9395cd21bb06 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:44.655281 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-a8976873-b01f-4511-a01d-efe7ff5083c1 req-9a51d1df-5988-41e4-bb14-d4b3744783c4 service nova] Creating event network-changed:d47c6ac3-a0dd-453a-a639-2012303e854a for instance c82cda25-d51b-490e-9102-3de1f9b9066b on hv-cinder-83608 Jun 02 13:36:44.660278 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d126b3c2-918f-4c63-a9ec-9395cd21bb06 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1299 microversion: 2.1 time: 0.725839 Jun 02 13:36:44.668376 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 22/46] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:43 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1299 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:44.676121 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7dad163d-6f0c-4823-8630-ebeb22f51853 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:44.677977 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-a8976873-b01f-4511-a01d-efe7ff5083c1 req-9a51d1df-5988-41e4-bb14-d4b3744783c4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.628062 Jun 02 13:36:44.679246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 25/47] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:44.692639 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6ea67a00-75b4-439e-ad9a-ecff9349b577 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:44.692813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7dad163d-6f0c-4823-8630-ebeb22f51853 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:44.693062 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6ea67a00-75b4-439e-ad9a-ecff9349b577 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:44.715835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7dad163d-6f0c-4823-8630-ebeb22f51853 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:44.729338 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7dad163d-6f0c-4823-8630-ebeb22f51853 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:44.731439 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7dad163d-6f0c-4823-8630-ebeb22f51853 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:44.733719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7dad163d-6f0c-4823-8630-ebeb22f51853 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:44.809466 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6ea67a00-75b4-439e-ad9a-ecff9349b577 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:44.818563 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6ea67a00-75b4-439e-ad9a-ecff9349b577 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:44.826687 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6ea67a00-75b4-439e-ad9a-ecff9349b577 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:44.827935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6ea67a00-75b4-439e-ad9a-ecff9349b577 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1281 microversion: 2.20 time: 0.147172 Jun 02 13:36:44.828514 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 26/48] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:44 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:36:44.841896 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c39764b2-c3ae-465c-b4d8-2c69070c4d35 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:44.842877 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c39764b2-c3ae-465c-b4d8-2c69070c4d35 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:44.857037 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c39764b2-c3ae-465c-b4d8-2c69070c4d35 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:44.857765 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c39764b2-c3ae-465c-b4d8-2c69070c4d35 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:44.862034 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c39764b2-c3ae-465c-b4d8-2c69070c4d35 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:44.862733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c39764b2-c3ae-465c-b4d8-2c69070c4d35 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:45.418570 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c39764b2-c3ae-465c-b4d8-2c69070c4d35 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:45.425915 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c39764b2-c3ae-465c-b4d8-2c69070c4d35 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.591014 Jun 02 13:36:45.426484 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 27/49] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:44 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:45.432914 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c58d6d6b-9513-4af2-bb47-57adfe609f9e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:45.433676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c58d6d6b-9513-4af2-bb47-57adfe609f9e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:45.443161 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c58d6d6b-9513-4af2-bb47-57adfe609f9e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:45.444973 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c58d6d6b-9513-4af2-bb47-57adfe609f9e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:45.445778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c58d6d6b-9513-4af2-bb47-57adfe609f9e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:45.446227 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c58d6d6b-9513-4af2-bb47-57adfe609f9e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:45.449693 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7dad163d-6f0c-4823-8630-ebeb22f51853 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:45.469367 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7dad163d-6f0c-4823-8630-ebeb22f51853 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 0.796884 Jun 02 13:36:45.481927 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 23/50] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:44 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:45.607166 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c58d6d6b-9513-4af2-bb47-57adfe609f9e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:45.618943 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c58d6d6b-9513-4af2-bb47-57adfe609f9e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1307 microversion: 2.1 time: 0.191418 Jun 02 13:36:45.620430 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 28/51] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:45 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1307 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:45.692104 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-408c5c51-743c-4902-bfd8-fce5070253a3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:45.693278 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-408c5c51-743c-4902-bfd8-fce5070253a3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:45.699955 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408c5c51-743c-4902-bfd8-fce5070253a3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:45.700452 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408c5c51-743c-4902-bfd8-fce5070253a3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:45.701282 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408c5c51-743c-4902-bfd8-fce5070253a3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:45.701726 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408c5c51-743c-4902-bfd8-fce5070253a3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:45.847420 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b01e31dd-3671-4e98-9d08-24f2959aaacb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:45.849700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b01e31dd-3671-4e98-9d08-24f2959aaacb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:45.869417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b01e31dd-3671-4e98-9d08-24f2959aaacb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:45.870643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b01e31dd-3671-4e98-9d08-24f2959aaacb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:45.872145 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b01e31dd-3671-4e98-9d08-24f2959aaacb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:45.877400 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b01e31dd-3671-4e98-9d08-24f2959aaacb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:46.077897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b01e31dd-3671-4e98-9d08-24f2959aaacb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:46.087774 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b01e31dd-3671-4e98-9d08-24f2959aaacb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:46.095953 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b01e31dd-3671-4e98-9d08-24f2959aaacb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:46.097437 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b01e31dd-3671-4e98-9d08-24f2959aaacb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1277 microversion: 2.20 time: 0.254063 Jun 02 13:36:46.098812 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 29/52] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:45 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1277 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:36:46.159266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-408c5c51-743c-4902-bfd8-fce5070253a3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:46.176833 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-408c5c51-743c-4902-bfd8-fce5070253a3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.488839 Jun 02 13:36:46.177436 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 24/53] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:45 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:46.443963 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-add897f2-f2a4-4ea5-ac4e-5ccb350073a3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:46.444713 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-add897f2-f2a4-4ea5-ac4e-5ccb350073a3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:46.452288 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-add897f2-f2a4-4ea5-ac4e-5ccb350073a3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:46.455121 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-add897f2-f2a4-4ea5-ac4e-5ccb350073a3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:46.458357 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-add897f2-f2a4-4ea5-ac4e-5ccb350073a3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:46.459226 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-add897f2-f2a4-4ea5-ac4e-5ccb350073a3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:46.492102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-32ee068a-c016-478d-aef0-136239779bcd tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:46.492951 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-32ee068a-c016-478d-aef0-136239779bcd tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:46.502645 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32ee068a-c016-478d-aef0-136239779bcd tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:46.503667 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32ee068a-c016-478d-aef0-136239779bcd tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:46.505762 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32ee068a-c016-478d-aef0-136239779bcd tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:46.507848 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32ee068a-c016-478d-aef0-136239779bcd tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:46.973959 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-add897f2-f2a4-4ea5-ac4e-5ccb350073a3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:46.982531 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-add897f2-f2a4-4ea5-ac4e-5ccb350073a3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.543162 Jun 02 13:36:46.983201 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 30/54] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:46 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:46.997008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-74e379ef-5177-4a84-b654-ec78f7307d6e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:46.997729 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-74e379ef-5177-4a84-b654-ec78f7307d6e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:47.001200 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-32ee068a-c016-478d-aef0-136239779bcd tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:47.006655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74e379ef-5177-4a84-b654-ec78f7307d6e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:47.007115 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74e379ef-5177-4a84-b654-ec78f7307d6e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:47.007895 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74e379ef-5177-4a84-b654-ec78f7307d6e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:47.008378 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74e379ef-5177-4a84-b654-ec78f7307d6e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:47.013133 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-32ee068a-c016-478d-aef0-136239779bcd tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 0.529786 Jun 02 13:36:47.018018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 25/55] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:46 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:47.024702 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-cc36e67e-a65e-43c7-8ca0-de22ba24645f req-38d2d8e8-abce-4035-82af-bd2d2a77c0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236e7657-e603-49d7-bd47-12254338360f", "tag": "791691ca-0e7d-4a40-afe0-33e7d2ffdc07"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:47.041982 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cc36e67e-a65e-43c7-8ca0-de22ba24645f req-38d2d8e8-abce-4035-82af-bd2d2a77c0ad service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:47.043289 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cc36e67e-a65e-43c7-8ca0-de22ba24645f req-38d2d8e8-abce-4035-82af-bd2d2a77c0ad service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:47.066522 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-cc36e67e-a65e-43c7-8ca0-de22ba24645f req-38d2d8e8-abce-4035-82af-bd2d2a77c0ad service nova] Creating event network-changed:791691ca-0e7d-4a40-afe0-33e7d2ffdc07 for instance 236e7657-e603-49d7-bd47-12254338360f on hv-cinder-83608 Jun 02 13:36:47.067088 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cc36e67e-a65e-43c7-8ca0-de22ba24645f req-38d2d8e8-abce-4035-82af-bd2d2a77c0ad service nova] Acquired lock "compute-rpcapi-router" {{(pid=124122) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 13:36:47.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-acd29ec0-c626-4818-9431-5cc65b943f6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:47.069070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-acd29ec0-c626-4818-9431-5cc65b943f6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:47.069867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-acd29ec0-c626-4818-9431-5cc65b943f6e None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:47.070318 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-acd29ec0-c626-4818-9431-5cc65b943f6e None None] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:47.081929 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.compute.rpcapi [None req-acd29ec0-c626-4818-9431-5cc65b943f6e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 13:36:47.083614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-acd29ec0-c626-4818-9431-5cc65b943f6e None None] Releasing lock "compute-rpcapi-router" {{(pid=124122) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 13:36:47.120440 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-acd29ec0-c626-4818-9431-5cc65b943f6e None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100852 Jun 02 13:36:47.121262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 26/56] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:47.127898 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f8c57efb-59e0-438e-acec-be51edb1f55b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:47.128852 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f8c57efb-59e0-438e-acec-be51edb1f55b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:47.136112 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8c57efb-59e0-438e-acec-be51edb1f55b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:47.137032 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8c57efb-59e0-438e-acec-be51edb1f55b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:47.137892 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8c57efb-59e0-438e-acec-be51edb1f55b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:47.138533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8c57efb-59e0-438e-acec-be51edb1f55b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:47.140911 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-74e379ef-5177-4a84-b654-ec78f7307d6e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:47.149380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-74e379ef-5177-4a84-b654-ec78f7307d6e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1295 microversion: 2.1 time: 0.164889 Jun 02 13:36:47.149962 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 31/57] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:46 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1295 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:47.195163 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-33581c00-1082-477e-a211-1719831b5219 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:47.196097 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-33581c00-1082-477e-a211-1719831b5219 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:47.203803 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-33581c00-1082-477e-a211-1719831b5219 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:47.204665 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-33581c00-1082-477e-a211-1719831b5219 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:47.205880 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-33581c00-1082-477e-a211-1719831b5219 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:47.206621 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-33581c00-1082-477e-a211-1719831b5219 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:47.278158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f8c57efb-59e0-438e-acec-be51edb1f55b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:47.291098 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f8c57efb-59e0-438e-acec-be51edb1f55b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:47.293102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f8c57efb-59e0-438e-acec-be51edb1f55b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:47.296381 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f8c57efb-59e0-438e-acec-be51edb1f55b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1333 microversion: 2.20 time: 0.173225 Jun 02 13:36:47.297291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 27/58] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:47 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1333 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:36:47.670797 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-33581c00-1082-477e-a211-1719831b5219 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:47.689933 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-33581c00-1082-477e-a211-1719831b5219 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.499202 Jun 02 13:36:47.691277 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 32/59] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:47 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:47.999852 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-62fe5b94-2b48-4e46-a936-870342355df3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:48.001014 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-62fe5b94-2b48-4e46-a936-870342355df3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:48.018192 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-62fe5b94-2b48-4e46-a936-870342355df3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:48.018664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-62fe5b94-2b48-4e46-a936-870342355df3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:48.019466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-62fe5b94-2b48-4e46-a936-870342355df3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:48.027638 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-62fe5b94-2b48-4e46-a936-870342355df3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:48.037514 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c970812d-a74f-4d5a-9ee9-2c97ec07e4e5 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:48.038500 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c970812d-a74f-4d5a-9ee9-2c97ec07e4e5 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:48.050647 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c970812d-a74f-4d5a-9ee9-2c97ec07e4e5 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:48.052270 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c970812d-a74f-4d5a-9ee9-2c97ec07e4e5 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:48.054353 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c970812d-a74f-4d5a-9ee9-2c97ec07e4e5 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:48.056366 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c970812d-a74f-4d5a-9ee9-2c97ec07e4e5 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:48.610316 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c970812d-a74f-4d5a-9ee9-2c97ec07e4e5 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:48.624412 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c970812d-a74f-4d5a-9ee9-2c97ec07e4e5 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 0.593033 Jun 02 13:36:48.639053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-62fe5b94-2b48-4e46-a936-870342355df3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:48.647807 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 33/60] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:48 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:48.651594 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-62fe5b94-2b48-4e46-a936-870342355df3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.655501 Jun 02 13:36:48.652710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 28/61] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:47 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:48.654142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b035ba51-821e-4b9f-926e-9d61d1ce5e58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:48.654918 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b035ba51-821e-4b9f-926e-9d61d1ce5e58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:48.663155 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ebebe0de-d235-4a21-9f48-0776f7b60347 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:48.664245 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b035ba51-821e-4b9f-926e-9d61d1ce5e58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:48.664707 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ebebe0de-d235-4a21-9f48-0776f7b60347 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:48.665088 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b035ba51-821e-4b9f-926e-9d61d1ce5e58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:48.666025 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b035ba51-821e-4b9f-926e-9d61d1ce5e58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:48.666750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b035ba51-821e-4b9f-926e-9d61d1ce5e58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:48.682374 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ebebe0de-d235-4a21-9f48-0776f7b60347 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:48.683406 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ebebe0de-d235-4a21-9f48-0776f7b60347 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:48.684411 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ebebe0de-d235-4a21-9f48-0776f7b60347 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:48.685004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ebebe0de-d235-4a21-9f48-0776f7b60347 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:49.056175 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ebebe0de-d235-4a21-9f48-0776f7b60347 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:49.070000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ebebe0de-d235-4a21-9f48-0776f7b60347 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:49.074223 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ebebe0de-d235-4a21-9f48-0776f7b60347 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:49.075789 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ebebe0de-d235-4a21-9f48-0776f7b60347 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1339 microversion: 2.20 time: 0.422134 Jun 02 13:36:49.078405 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 29/62] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:48 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1339 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:36:49.087184 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dafcf879-9418-4556-a317-139332b8682c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:49.088121 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dafcf879-9418-4556-a317-139332b8682c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:49.107197 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dafcf879-9418-4556-a317-139332b8682c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:49.107664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dafcf879-9418-4556-a317-139332b8682c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:49.109388 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dafcf879-9418-4556-a317-139332b8682c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:49.110807 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dafcf879-9418-4556-a317-139332b8682c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:49.405567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b035ba51-821e-4b9f-926e-9d61d1ce5e58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:49.414769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b035ba51-821e-4b9f-926e-9d61d1ce5e58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.765548 Jun 02 13:36:49.426876 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 34/63] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:48 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:49.435000 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-97c8da09-81ec-48ba-9713-f36c4e8c3e26 req-28b28e35-0cb3-416b-9445-1b4f0a941365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123ffac0-b1c6-4d56-a959-9dddf4e649c3", "tag": "ce43ce14-85b8-42b3-a50e-e16e10512b50"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:49.453032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-97c8da09-81ec-48ba-9713-f36c4e8c3e26 req-28b28e35-0cb3-416b-9445-1b4f0a941365 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:49.453487 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-97c8da09-81ec-48ba-9713-f36c4e8c3e26 req-28b28e35-0cb3-416b-9445-1b4f0a941365 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:49.488977 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-97c8da09-81ec-48ba-9713-f36c4e8c3e26 req-28b28e35-0cb3-416b-9445-1b4f0a941365 service nova] Creating event network-changed:ce43ce14-85b8-42b3-a50e-e16e10512b50 for instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 on hv-cinder-83608 Jun 02 13:36:49.497846 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-97c8da09-81ec-48ba-9713-f36c4e8c3e26 req-28b28e35-0cb3-416b-9445-1b4f0a941365 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069429 Jun 02 13:36:49.501085 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 35/64] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:49.643023 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-31710482-d1a3-4bf3-a70c-d9539fde09fb tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:49.643733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-31710482-d1a3-4bf3-a70c-d9539fde09fb tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:49.655140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-31710482-d1a3-4bf3-a70c-d9539fde09fb tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:49.656840 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-31710482-d1a3-4bf3-a70c-d9539fde09fb tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:49.659780 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-31710482-d1a3-4bf3-a70c-d9539fde09fb tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:49.660435 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-31710482-d1a3-4bf3-a70c-d9539fde09fb tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:49.901989 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dafcf879-9418-4556-a317-139332b8682c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:49.914159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dafcf879-9418-4556-a317-139332b8682c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.832225 Jun 02 13:36:49.916107 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 30/65] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:49 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:49.935006 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-30c16914-2f0c-4b06-899f-b747aa6e683d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:49.935820 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-30c16914-2f0c-4b06-899f-b747aa6e683d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:49.943548 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-30c16914-2f0c-4b06-899f-b747aa6e683d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:49.944936 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-30c16914-2f0c-4b06-899f-b747aa6e683d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:49.945936 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-30c16914-2f0c-4b06-899f-b747aa6e683d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:49.947414 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-30c16914-2f0c-4b06-899f-b747aa6e683d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:50.306763 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-31710482-d1a3-4bf3-a70c-d9539fde09fb tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:50.315767 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-31710482-d1a3-4bf3-a70c-d9539fde09fb tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 0.676926 Jun 02 13:36:50.321458 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 36/66] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:49 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:50.329495 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1bb08013-28a5-4543-8d09-dd805d2d4c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:50.337832 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1bb08013-28a5-4543-8d09-dd805d2d4c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:50.350454 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1bb08013-28a5-4543-8d09-dd805d2d4c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:50.351138 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1bb08013-28a5-4543-8d09-dd805d2d4c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:50.352071 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1bb08013-28a5-4543-8d09-dd805d2d4c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:50.356447 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1bb08013-28a5-4543-8d09-dd805d2d4c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:50.416614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-30c16914-2f0c-4b06-899f-b747aa6e683d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:50.426432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-30c16914-2f0c-4b06-899f-b747aa6e683d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.508400 Jun 02 13:36:50.429612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 31/67] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:49 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:50.435595 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-5bd19ffd-528d-4bda-bcc6-ff77a7336423 req-fd8dff6a-b2b9-4724-90aa-98dde6cd92b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ef14f4-ad83-4f47-bcf7-cd051e84dcef", "tag": "eae534a3-0e2b-44d2-90c9-88a5548068b2"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:50.451264 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-5bd19ffd-528d-4bda-bcc6-ff77a7336423 req-fd8dff6a-b2b9-4724-90aa-98dde6cd92b5 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:50.452839 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-5bd19ffd-528d-4bda-bcc6-ff77a7336423 req-fd8dff6a-b2b9-4724-90aa-98dde6cd92b5 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:50.476420 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-5bd19ffd-528d-4bda-bcc6-ff77a7336423 req-fd8dff6a-b2b9-4724-90aa-98dde6cd92b5 service nova] Creating event network-changed:eae534a3-0e2b-44d2-90c9-88a5548068b2 for instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef on hv-cinder-83608 Jun 02 13:36:50.489888 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-5bd19ffd-528d-4bda-bcc6-ff77a7336423 req-fd8dff6a-b2b9-4724-90aa-98dde6cd92b5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058805 Jun 02 13:36:50.492587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 32/68] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:50.505188 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2043ee17-3cd9-4193-a9b4-fd87304df194 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:50.507521 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2043ee17-3cd9-4193-a9b4-fd87304df194 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:50.521262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2043ee17-3cd9-4193-a9b4-fd87304df194 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:50.524289 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2043ee17-3cd9-4193-a9b4-fd87304df194 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:50.525632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2043ee17-3cd9-4193-a9b4-fd87304df194 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:50.526734 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2043ee17-3cd9-4193-a9b4-fd87304df194 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:50.571081 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1bb08013-28a5-4543-8d09-dd805d2d4c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:50.583586 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1bb08013-28a5-4543-8d09-dd805d2d4c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:50.587528 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1bb08013-28a5-4543-8d09-dd805d2d4c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:50.591099 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1bb08013-28a5-4543-8d09-dd805d2d4c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.265942 Jun 02 13:36:50.604672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 37/69] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:50 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:36:50.733014 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2043ee17-3cd9-4193-a9b4-fd87304df194 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:50.742228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2043ee17-3cd9-4193-a9b4-fd87304df194 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.246989 Jun 02 13:36:50.743137 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 33/70] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:50 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:50.933150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-14ba9b2d-4ef6-40be-88c8-dac91e42ebc3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:50.934006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-14ba9b2d-4ef6-40be-88c8-dac91e42ebc3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:50.942389 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-14ba9b2d-4ef6-40be-88c8-dac91e42ebc3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:50.943588 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-14ba9b2d-4ef6-40be-88c8-dac91e42ebc3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:50.945134 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-14ba9b2d-4ef6-40be-88c8-dac91e42ebc3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:50.945726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-14ba9b2d-4ef6-40be-88c8-dac91e42ebc3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:51.326917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:51.338619 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-da05bf10-a9d5-4191-8d4b-535ffb4c0df8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:51.339646 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-da05bf10-a9d5-4191-8d4b-535ffb4c0df8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:51.346255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-da05bf10-a9d5-4191-8d4b-535ffb4c0df8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:51.346722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-da05bf10-a9d5-4191-8d4b-535ffb4c0df8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:51.347505 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-da05bf10-a9d5-4191-8d4b-535ffb4c0df8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:51.364632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-da05bf10-a9d5-4191-8d4b-535ffb4c0df8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:52.180234 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-14ba9b2d-4ef6-40be-88c8-dac91e42ebc3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:52.188867 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-14ba9b2d-4ef6-40be-88c8-dac91e42ebc3 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 1.259420 Jun 02 13:36:52.192396 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 38/71] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:50 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:52.208050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c9a4b3cb-47e1-4b18-900b-d84b1ccefa57 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:52.216983 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c9a4b3cb-47e1-4b18-900b-d84b1ccefa57 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:52.236416 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9a4b3cb-47e1-4b18-900b-d84b1ccefa57 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:52.237543 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9a4b3cb-47e1-4b18-900b-d84b1ccefa57 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:52.239629 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9a4b3cb-47e1-4b18-900b-d84b1ccefa57 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:52.243545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9a4b3cb-47e1-4b18-900b-d84b1ccefa57 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:52.316324 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-da05bf10-a9d5-4191-8d4b-535ffb4c0df8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:52.325421 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-da05bf10-a9d5-4191-8d4b-535ffb4c0df8 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 0.991967 Jun 02 13:36:52.340971 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 34/72] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:51 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:52.363141 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5a82f19d-4755-4373-afe9-1b8aefb82259 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:52.363767 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5a82f19d-4755-4373-afe9-1b8aefb82259 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:52.383926 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a82f19d-4755-4373-afe9-1b8aefb82259 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:52.384446 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a82f19d-4755-4373-afe9-1b8aefb82259 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:52.385190 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a82f19d-4755-4373-afe9-1b8aefb82259 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:52.385634 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a82f19d-4755-4373-afe9-1b8aefb82259 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:52.698124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c9a4b3cb-47e1-4b18-900b-d84b1ccefa57 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:52.708404 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c9a4b3cb-47e1-4b18-900b-d84b1ccefa57 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.513772 Jun 02 13:36:52.710125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 39/73] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:52 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:52.718573 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-20874e5f-6415-46bc-9665-b5669bc1e5e8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:52.719442 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-20874e5f-6415-46bc-9665-b5669bc1e5e8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:52.730240 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20874e5f-6415-46bc-9665-b5669bc1e5e8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:52.730927 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20874e5f-6415-46bc-9665-b5669bc1e5e8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:52.731976 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20874e5f-6415-46bc-9665-b5669bc1e5e8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:52.735107 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20874e5f-6415-46bc-9665-b5669bc1e5e8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:52.761861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5a82f19d-4755-4373-afe9-1b8aefb82259 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:52.770315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5a82f19d-4755-4373-afe9-1b8aefb82259 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:52.782305 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5a82f19d-4755-4373-afe9-1b8aefb82259 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:52.783854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5a82f19d-4755-4373-afe9-1b8aefb82259 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.441622 Jun 02 13:36:52.794940 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 35/74] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:52 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:36:53.001959 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-20874e5f-6415-46bc-9665-b5669bc1e5e8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:53.009967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:53.021539 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-20874e5f-6415-46bc-9665-b5669bc1e5e8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.309776 Jun 02 13:36:53.022465 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 40/75] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:52 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:53.028963 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-12a2bfcd-5694-49ea-a4fc-0b446913fc75 req-82bf3f7b-ad4a-4639-ae66-fb31f3f46518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf15208f-0bda-407c-8ea0-38a1300bfa16", "tag": "8aab5ca9-b3de-4176-a679-2976edeca505"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:53.047033 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-12a2bfcd-5694-49ea-a4fc-0b446913fc75 req-82bf3f7b-ad4a-4639-ae66-fb31f3f46518 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:53.047484 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-12a2bfcd-5694-49ea-a4fc-0b446913fc75 req-82bf3f7b-ad4a-4639-ae66-fb31f3f46518 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:53.061218 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-12a2bfcd-5694-49ea-a4fc-0b446913fc75 req-82bf3f7b-ad4a-4639-ae66-fb31f3f46518 service nova] Creating event network-changed:8aab5ca9-b3de-4176-a679-2976edeca505 for instance bf15208f-0bda-407c-8ea0-38a1300bfa16 on hv-cinder-83608 Jun 02 13:36:53.066619 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-12a2bfcd-5694-49ea-a4fc-0b446913fc75 req-82bf3f7b-ad4a-4639-ae66-fb31f3f46518 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041615 Jun 02 13:36:53.067423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 41/76] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:53.093736 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-55c0a8b0-7b0d-4ba0-9d0d-19f9a7abfdcd req-82d819f3-78bc-47cf-be01-e37b6fb1dafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b39de5-4a0e-4232-840a-69b48be6b336", "name": "network-vif-plugged", "status": "completed", "tag": "5cea31d6-3312-484a-b0a9-2d3fedd84f23"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:53.102774 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-55c0a8b0-7b0d-4ba0-9d0d-19f9a7abfdcd req-82d819f3-78bc-47cf-be01-e37b6fb1dafc service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:53.103605 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-55c0a8b0-7b0d-4ba0-9d0d-19f9a7abfdcd req-82d819f3-78bc-47cf-be01-e37b6fb1dafc service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:53.106537 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:53.117567 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-55c0a8b0-7b0d-4ba0-9d0d-19f9a7abfdcd req-82d819f3-78bc-47cf-be01-e37b6fb1dafc service nova] Creating event network-vif-plugged:5cea31d6-3312-484a-b0a9-2d3fedd84f23 for instance 26b39de5-4a0e-4232-840a-69b48be6b336 on hv-cinder-83608 Jun 02 13:36:53.122731 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-55c0a8b0-7b0d-4ba0-9d0d-19f9a7abfdcd req-82d819f3-78bc-47cf-be01-e37b6fb1dafc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326257 Jun 02 13:36:53.123500 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 36/77] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:53.210247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-95123cd2-3623-4a88-95d0-2bd7dfa8a6af tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:53.211577 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-95123cd2-3623-4a88-95d0-2bd7dfa8a6af tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:53.222132 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-95123cd2-3623-4a88-95d0-2bd7dfa8a6af tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:53.228830 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-95123cd2-3623-4a88-95d0-2bd7dfa8a6af tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:53.229869 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-95123cd2-3623-4a88-95d0-2bd7dfa8a6af tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:53.230473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-95123cd2-3623-4a88-95d0-2bd7dfa8a6af tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:53.351652 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5afb127b-b198-43a7-ac4e-405ca0ea0d37 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:53.352979 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5afb127b-b198-43a7-ac4e-405ca0ea0d37 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:53.367988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5afb127b-b198-43a7-ac4e-405ca0ea0d37 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:53.370146 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5afb127b-b198-43a7-ac4e-405ca0ea0d37 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:53.372187 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5afb127b-b198-43a7-ac4e-405ca0ea0d37 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:53.374002 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5afb127b-b198-43a7-ac4e-405ca0ea0d37 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:53.841901 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=5 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:54.034192 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-95123cd2-3623-4a88-95d0-2bd7dfa8a6af tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:54.051657 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-95123cd2-3623-4a88-95d0-2bd7dfa8a6af tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.846077 Jun 02 13:36:54.060160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5afb127b-b198-43a7-ac4e-405ca0ea0d37 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:54.081984 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 42/78] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:53 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:54.086193 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5afb127b-b198-43a7-ac4e-405ca0ea0d37 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 0.740514 Jun 02 13:36:54.088364 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 37/79] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:53 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:54.109083 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0dcb7092-57d5-4878-8982-21d55180a3c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:54.110310 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0dcb7092-57d5-4878-8982-21d55180a3c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:54.111141 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6ebdf7e2-377c-4db4-b92c-caf13c8a699b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:54.112524 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6ebdf7e2-377c-4db4-b92c-caf13c8a699b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:54.130736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0dcb7092-57d5-4878-8982-21d55180a3c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:54.144734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0dcb7092-57d5-4878-8982-21d55180a3c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:54.148662 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0dcb7092-57d5-4878-8982-21d55180a3c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:54.149169 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0dcb7092-57d5-4878-8982-21d55180a3c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:54.153013 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ebdf7e2-377c-4db4-b92c-caf13c8a699b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:54.154500 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ebdf7e2-377c-4db4-b92c-caf13c8a699b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:54.154636 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ebdf7e2-377c-4db4-b92c-caf13c8a699b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:54.155185 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ebdf7e2-377c-4db4-b92c-caf13c8a699b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:54.814375 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=8 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:54.835175 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6ebdf7e2-377c-4db4-b92c-caf13c8a699b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:54.876632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6ebdf7e2-377c-4db4-b92c-caf13c8a699b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:54.878291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6ebdf7e2-377c-4db4-b92c-caf13c8a699b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:54.879438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6ebdf7e2-377c-4db4-b92c-caf13c8a699b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.789069 Jun 02 13:36:54.886219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 38/80] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:54 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:36:54.895790 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-044a0c6d-8ee9-4c6f-a670-b331200dec55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:54.897283 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-044a0c6d-8ee9-4c6f-a670-b331200dec55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:54.900968 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0dcb7092-57d5-4878-8982-21d55180a3c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:54.908075 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-044a0c6d-8ee9-4c6f-a670-b331200dec55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:54.908530 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-044a0c6d-8ee9-4c6f-a670-b331200dec55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:54.909380 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-044a0c6d-8ee9-4c6f-a670-b331200dec55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:54.909821 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-044a0c6d-8ee9-4c6f-a670-b331200dec55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:54.914073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0dcb7092-57d5-4878-8982-21d55180a3c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.827541 Jun 02 13:36:54.924664 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 43/81] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:54 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:55.100672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-67423688-d76b-4517-bdb5-b82e5af05188 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:55.101629 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-67423688-d76b-4517-bdb5-b82e5af05188 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:55.113056 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67423688-d76b-4517-bdb5-b82e5af05188 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:55.113525 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67423688-d76b-4517-bdb5-b82e5af05188 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:55.114310 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67423688-d76b-4517-bdb5-b82e5af05188 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:55.114751 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67423688-d76b-4517-bdb5-b82e5af05188 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:55.325917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-67423688-d76b-4517-bdb5-b82e5af05188 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:55.336211 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-67423688-d76b-4517-bdb5-b82e5af05188 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.240835 Jun 02 13:36:55.342445 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 44/82] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:55 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:55.353265 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-044a0c6d-8ee9-4c6f-a670-b331200dec55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:55.357192 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-49e505ab-20d5-4ef1-a88b-24aa868bbcf6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:55.358024 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-49e505ab-20d5-4ef1-a88b-24aa868bbcf6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:55.366313 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49e505ab-20d5-4ef1-a88b-24aa868bbcf6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:55.366928 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49e505ab-20d5-4ef1-a88b-24aa868bbcf6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:55.367802 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49e505ab-20d5-4ef1-a88b-24aa868bbcf6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:55.368400 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49e505ab-20d5-4ef1-a88b-24aa868bbcf6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:55.371771 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-044a0c6d-8ee9-4c6f-a670-b331200dec55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.483731 Jun 02 13:36:55.372927 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 39/83] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:54 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:55.387727 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-788b525b-99b1-42c8-9a58-319f00430d8f req-ebea70e4-8215-4f92-b4ea-56c2d71cbd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82cda25-d51b-490e-9102-3de1f9b9066b", "name": "network-vif-plugged", "status": "completed", "tag": "d47c6ac3-a0dd-453a-a639-2012303e854a"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:55.403613 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-788b525b-99b1-42c8-9a58-319f00430d8f req-ebea70e4-8215-4f92-b4ea-56c2d71cbd67 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:55.404733 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-788b525b-99b1-42c8-9a58-319f00430d8f req-ebea70e4-8215-4f92-b4ea-56c2d71cbd67 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:55.429084 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-788b525b-99b1-42c8-9a58-319f00430d8f req-ebea70e4-8215-4f92-b4ea-56c2d71cbd67 service nova] Creating event network-vif-plugged:d47c6ac3-a0dd-453a-a639-2012303e854a for instance c82cda25-d51b-490e-9102-3de1f9b9066b on hv-cinder-83608 Jun 02 13:36:55.434667 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-788b525b-99b1-42c8-9a58-319f00430d8f req-ebea70e4-8215-4f92-b4ea-56c2d71cbd67 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059612 Jun 02 13:36:55.435813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 40/84] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:55.561654 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-49e505ab-20d5-4ef1-a88b-24aa868bbcf6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:55.573435 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-49e505ab-20d5-4ef1-a88b-24aa868bbcf6 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 0.229636 Jun 02 13:36:55.574625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 45/85] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:55 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:55.906421 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c212d39a-d22b-4f90-a8d2-4c7cd840ada4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:55.907256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c212d39a-d22b-4f90-a8d2-4c7cd840ada4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:55.915143 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c212d39a-d22b-4f90-a8d2-4c7cd840ada4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:55.915596 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c212d39a-d22b-4f90-a8d2-4c7cd840ada4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:55.916429 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c212d39a-d22b-4f90-a8d2-4c7cd840ada4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:55.916900 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c212d39a-d22b-4f90-a8d2-4c7cd840ada4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:55.931941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-61f4cc69-8175-4eeb-9563-3bf5f3f6a3aa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:55.932402 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-61f4cc69-8175-4eeb-9563-3bf5f3f6a3aa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:55.938911 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61f4cc69-8175-4eeb-9563-3bf5f3f6a3aa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:55.939376 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61f4cc69-8175-4eeb-9563-3bf5f3f6a3aa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:55.940156 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61f4cc69-8175-4eeb-9563-3bf5f3f6a3aa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:55.940638 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61f4cc69-8175-4eeb-9563-3bf5f3f6a3aa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:56.109119 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c212d39a-d22b-4f90-a8d2-4c7cd840ada4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:56.117958 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c212d39a-d22b-4f90-a8d2-4c7cd840ada4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:56.119228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c212d39a-d22b-4f90-a8d2-4c7cd840ada4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:56.120375 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c212d39a-d22b-4f90-a8d2-4c7cd840ada4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.219229 Jun 02 13:36:56.121278 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 41/86] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:55 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:36:56.149149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-61f4cc69-8175-4eeb-9563-3bf5f3f6a3aa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:56.156561 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-61f4cc69-8175-4eeb-9563-3bf5f3f6a3aa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.228959 Jun 02 13:36:56.157179 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 46/87] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:55 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:56.354282 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a137f98e-62a5-4860-b512-3598f207411a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:56.354914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a137f98e-62a5-4860-b512-3598f207411a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:56.361021 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a137f98e-62a5-4860-b512-3598f207411a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:56.361479 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a137f98e-62a5-4860-b512-3598f207411a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:56.362598 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a137f98e-62a5-4860-b512-3598f207411a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:56.363047 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a137f98e-62a5-4860-b512-3598f207411a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:56.391630 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f04587c1-46c9-49b0-b1a8-d3ad31a08e6a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:56.392716 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f04587c1-46c9-49b0-b1a8-d3ad31a08e6a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:56.402003 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f04587c1-46c9-49b0-b1a8-d3ad31a08e6a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:56.403142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f04587c1-46c9-49b0-b1a8-d3ad31a08e6a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:56.404129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f04587c1-46c9-49b0-b1a8-d3ad31a08e6a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:56.404980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f04587c1-46c9-49b0-b1a8-d3ad31a08e6a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:56.567455 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a137f98e-62a5-4860-b512-3598f207411a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:56.577373 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a137f98e-62a5-4860-b512-3598f207411a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.226695 Jun 02 13:36:56.588565 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 42/88] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:56 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:56.601738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f04587c1-46c9-49b0-b1a8-d3ad31a08e6a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:56.607006 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a2340ebb-6077-4371-8487-d41602430ba3 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:56.610476 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f04587c1-46c9-49b0-b1a8-d3ad31a08e6a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.223872 Jun 02 13:36:56.610702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 47/89] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:56 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:56.613823 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a2340ebb-6077-4371-8487-d41602430ba3 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:56.640669 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a2340ebb-6077-4371-8487-d41602430ba3 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:56.644873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a2340ebb-6077-4371-8487-d41602430ba3 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:56.646760 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a2340ebb-6077-4371-8487-d41602430ba3 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:56.648708 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a2340ebb-6077-4371-8487-d41602430ba3 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:56.796170 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a2340ebb-6077-4371-8487-d41602430ba3 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:56.804636 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a2340ebb-6077-4371-8487-d41602430ba3 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1314 microversion: 2.1 time: 0.201414 Jun 02 13:36:56.805419 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 43/90] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:56 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:57.138459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-09edc7f7-6e46-45c3-91cb-48280976da69 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:57.139289 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-09edc7f7-6e46-45c3-91cb-48280976da69 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:57.145879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09edc7f7-6e46-45c3-91cb-48280976da69 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.146558 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09edc7f7-6e46-45c3-91cb-48280976da69 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:57.147346 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09edc7f7-6e46-45c3-91cb-48280976da69 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.147940 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09edc7f7-6e46-45c3-91cb-48280976da69 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:57.174668 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-43e4caa7-85ed-410b-8c4d-4b97b0126894 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:57.175611 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-43e4caa7-85ed-410b-8c4d-4b97b0126894 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:57.179330 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=6 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:57.197603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-43e4caa7-85ed-410b-8c4d-4b97b0126894 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.199120 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-43e4caa7-85ed-410b-8c4d-4b97b0126894 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:57.201924 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-43e4caa7-85ed-410b-8c4d-4b97b0126894 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.207035 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-43e4caa7-85ed-410b-8c4d-4b97b0126894 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:57.342278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-09edc7f7-6e46-45c3-91cb-48280976da69 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:57.354281 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-09edc7f7-6e46-45c3-91cb-48280976da69 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:57.358129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-09edc7f7-6e46-45c3-91cb-48280976da69 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:57.361615 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-09edc7f7-6e46-45c3-91cb-48280976da69 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.227186 Jun 02 13:36:57.366091 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 48/91] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:57 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:36:57.421189 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-43e4caa7-85ed-410b-8c4d-4b97b0126894 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:57.429864 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-43e4caa7-85ed-410b-8c4d-4b97b0126894 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.259964 Jun 02 13:36:57.430432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 44/92] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:57 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:57.452608 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-fb195708-28ee-444f-b3e6-05820fa14e7a req-a2211020-1aec-4ac0-a8a6-f64987d7b1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236e7657-e603-49d7-bd47-12254338360f", "name": "network-vif-plugged", "status": "completed", "tag": "791691ca-0e7d-4a40-afe0-33e7d2ffdc07"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:57.462877 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-fb195708-28ee-444f-b3e6-05820fa14e7a req-a2211020-1aec-4ac0-a8a6-f64987d7b1d0 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.463434 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-fb195708-28ee-444f-b3e6-05820fa14e7a req-a2211020-1aec-4ac0-a8a6-f64987d7b1d0 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:57.478114 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-fb195708-28ee-444f-b3e6-05820fa14e7a req-a2211020-1aec-4ac0-a8a6-f64987d7b1d0 service nova] Creating event network-vif-plugged:791691ca-0e7d-4a40-afe0-33e7d2ffdc07 for instance 236e7657-e603-49d7-bd47-12254338360f on hv-cinder-83608 Jun 02 13:36:57.483475 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-fb195708-28ee-444f-b3e6-05820fa14e7a req-a2211020-1aec-4ac0-a8a6-f64987d7b1d0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034401 Jun 02 13:36:57.484557 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 49/93] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:57.594770 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f601bd9f-d35f-45df-93e6-9d00574196e6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:57.595396 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f601bd9f-d35f-45df-93e6-9d00574196e6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:57.601926 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f601bd9f-d35f-45df-93e6-9d00574196e6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.602385 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f601bd9f-d35f-45df-93e6-9d00574196e6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:57.603160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f601bd9f-d35f-45df-93e6-9d00574196e6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.603604 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f601bd9f-d35f-45df-93e6-9d00574196e6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:57.627381 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4d789369-7243-4e07-95d0-0e8074901802 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:57.628469 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4d789369-7243-4e07-95d0-0e8074901802 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:57.635446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d789369-7243-4e07-95d0-0e8074901802 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.636213 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d789369-7243-4e07-95d0-0e8074901802 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:57.637230 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d789369-7243-4e07-95d0-0e8074901802 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.637906 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d789369-7243-4e07-95d0-0e8074901802 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:57.850629 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f601bd9f-d35f-45df-93e6-9d00574196e6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:57.862627 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4d789369-7243-4e07-95d0-0e8074901802 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:57.869575 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f601bd9f-d35f-45df-93e6-9d00574196e6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.277658 Jun 02 13:36:57.871093 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 45/94] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:57 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:57.873621 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4d789369-7243-4e07-95d0-0e8074901802 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.250361 Jun 02 13:36:57.874419 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 50/95] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:57 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:57.886057 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d4f112d6-7ec5-4c09-8f63-a14a305ae136 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:57.886057 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d4f112d6-7ec5-4c09-8f63-a14a305ae136 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:57.886057 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4f112d6-7ec5-4c09-8f63-a14a305ae136 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.886057 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4f112d6-7ec5-4c09-8f63-a14a305ae136 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:57.887040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4f112d6-7ec5-4c09-8f63-a14a305ae136 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:57.887523 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4f112d6-7ec5-4c09-8f63-a14a305ae136 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:58.033718 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d4f112d6-7ec5-4c09-8f63-a14a305ae136 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:58.041765 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d4f112d6-7ec5-4c09-8f63-a14a305ae136 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1501 microversion: 2.1 time: 0.169333 Jun 02 13:36:58.042337 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 46/96] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:57 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:58.384345 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e7ad0e90-7cd0-4d4d-ad15-a6f4b9830ebd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:58.385787 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e7ad0e90-7cd0-4d4d-ad15-a6f4b9830ebd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:58.398117 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7ad0e90-7cd0-4d4d-ad15-a6f4b9830ebd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:58.399209 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7ad0e90-7cd0-4d4d-ad15-a6f4b9830ebd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:58.400488 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7ad0e90-7cd0-4d4d-ad15-a6f4b9830ebd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:58.401793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7ad0e90-7cd0-4d4d-ad15-a6f4b9830ebd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:58.446993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6ba2863e-cf90-4837-8f70-896d643f28f1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:58.447670 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6ba2863e-cf90-4837-8f70-896d643f28f1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:58.460222 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ba2863e-cf90-4837-8f70-896d643f28f1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:58.463048 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ba2863e-cf90-4837-8f70-896d643f28f1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:58.465084 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ba2863e-cf90-4837-8f70-896d643f28f1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:58.469240 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ba2863e-cf90-4837-8f70-896d643f28f1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:58.771352 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e7ad0e90-7cd0-4d4d-ad15-a6f4b9830ebd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:58.774370 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6ba2863e-cf90-4837-8f70-896d643f28f1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:58.779585 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e7ad0e90-7cd0-4d4d-ad15-a6f4b9830ebd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:58.781372 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e7ad0e90-7cd0-4d4d-ad15-a6f4b9830ebd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:58.782478 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e7ad0e90-7cd0-4d4d-ad15-a6f4b9830ebd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.403265 Jun 02 13:36:58.782748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6ba2863e-cf90-4837-8f70-896d643f28f1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.340220 Jun 02 13:36:58.783013 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 51/97] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:58 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:36:58.783379 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 47/98] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:58 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:58.887058 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cac08b5a-d16a-48a9-9f34-ece7036fe9dc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:58.887753 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cac08b5a-d16a-48a9-9f34-ece7036fe9dc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:58.893469 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ed6c4914-16ca-4341-94c9-47a36c554f2c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:58.894084 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ed6c4914-16ca-4341-94c9-47a36c554f2c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:58.894242 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cac08b5a-d16a-48a9-9f34-ece7036fe9dc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:58.894876 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cac08b5a-d16a-48a9-9f34-ece7036fe9dc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:58.895800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cac08b5a-d16a-48a9-9f34-ece7036fe9dc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:58.896417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cac08b5a-d16a-48a9-9f34-ece7036fe9dc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:58.901404 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed6c4914-16ca-4341-94c9-47a36c554f2c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:58.902130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed6c4914-16ca-4341-94c9-47a36c554f2c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:58.902909 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed6c4914-16ca-4341-94c9-47a36c554f2c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:58.903406 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed6c4914-16ca-4341-94c9-47a36c554f2c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:59.151007 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cac08b5a-d16a-48a9-9f34-ece7036fe9dc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:59.159486 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cac08b5a-d16a-48a9-9f34-ece7036fe9dc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.276314 Jun 02 13:36:59.160019 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ed6c4914-16ca-4341-94c9-47a36c554f2c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:59.160935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 52/99] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:58 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:36:59.171180 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ed6c4914-16ca-4341-94c9-47a36c554f2c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.281839 Jun 02 13:36:59.172075 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 48/100] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:58 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:59.522695 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-deaf7ed3-624e-4b24-9109-407041ebac69 req-483a1677-3c63-4e8a-8790-0d697896ebfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123ffac0-b1c6-4d56-a959-9dddf4e649c3", "name": "network-vif-plugged", "status": "completed", "tag": "ce43ce14-85b8-42b3-a50e-e16e10512b50"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:59.534444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-deaf7ed3-624e-4b24-9109-407041ebac69 req-483a1677-3c63-4e8a-8790-0d697896ebfa service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:59.535329 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-deaf7ed3-624e-4b24-9109-407041ebac69 req-483a1677-3c63-4e8a-8790-0d697896ebfa service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:59.549854 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-deaf7ed3-624e-4b24-9109-407041ebac69 req-483a1677-3c63-4e8a-8790-0d697896ebfa service nova] Creating event network-vif-plugged:ce43ce14-85b8-42b3-a50e-e16e10512b50 for instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 on hv-cinder-83608 Jun 02 13:36:59.556035 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-deaf7ed3-624e-4b24-9109-407041ebac69 req-483a1677-3c63-4e8a-8790-0d697896ebfa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036936 Jun 02 13:36:59.556913 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 53/101] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:36:59.592446 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-679eeb90-776e-4e13-8ce3-515b7734e64e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f860c333-3699-4d78-93e8-107173f2fbb4"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:36:59.592933 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-679eeb90-776e-4e13-8ce3-515b7734e64e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:59.598659 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-679eeb90-776e-4e13-8ce3-515b7734e64e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:59.599119 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-679eeb90-776e-4e13-8ce3-515b7734e64e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:59.600519 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-679eeb90-776e-4e13-8ce3-515b7734e64e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:59.600968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-679eeb90-776e-4e13-8ce3-515b7734e64e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:59.801637 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-49063098-97f5-44fb-98a6-36ded2d30559 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:59.801637 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-49063098-97f5-44fb-98a6-36ded2d30559 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:59.808216 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49063098-97f5-44fb-98a6-36ded2d30559 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:59.808408 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49063098-97f5-44fb-98a6-36ded2d30559 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:59.809055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49063098-97f5-44fb-98a6-36ded2d30559 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:59.809545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49063098-97f5-44fb-98a6-36ded2d30559 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:59.958720 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-49063098-97f5-44fb-98a6-36ded2d30559 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:36:59.970825 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-49063098-97f5-44fb-98a6-36ded2d30559 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.175202 Jun 02 13:36:59.972015 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 54/102] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:36:59 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:36:59.977270 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-32e73a61-9b83-42b5-8ac0-e776bbce1fd5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:36:59.977873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-32e73a61-9b83-42b5-8ac0-e776bbce1fd5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:36:59.983833 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32e73a61-9b83-42b5-8ac0-e776bbce1fd5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:59.984283 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32e73a61-9b83-42b5-8ac0-e776bbce1fd5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:36:59.985074 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32e73a61-9b83-42b5-8ac0-e776bbce1fd5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:36:59.985635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32e73a61-9b83-42b5-8ac0-e776bbce1fd5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:00.168421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-32e73a61-9b83-42b5-8ac0-e776bbce1fd5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:00.178860 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-32e73a61-9b83-42b5-8ac0-e776bbce1fd5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:00.180551 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-32e73a61-9b83-42b5-8ac0-e776bbce1fd5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:00.181945 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-32e73a61-9b83-42b5-8ac0-e776bbce1fd5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.208977 Jun 02 13:37:00.182650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 55/103] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:36:59 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:37:00.187764 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-158967e0-a43c-4ee8-aed3-e2e0822b72e8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:00.188671 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-158967e0-a43c-4ee8-aed3-e2e0822b72e8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:00.195537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-158967e0-a43c-4ee8-aed3-e2e0822b72e8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:00.196056 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-158967e0-a43c-4ee8-aed3-e2e0822b72e8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:00.196929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-158967e0-a43c-4ee8-aed3-e2e0822b72e8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:00.197434 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-158967e0-a43c-4ee8-aed3-e2e0822b72e8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:00.332906 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-158967e0-a43c-4ee8-aed3-e2e0822b72e8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:00.341030 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-158967e0-a43c-4ee8-aed3-e2e0822b72e8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.156851 Jun 02 13:37:00.341627 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 56/104] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:00 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:00.346349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-941eba96-7fe9-4173-b75d-83d0a7292948 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:00.346858 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-941eba96-7fe9-4173-b75d-83d0a7292948 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:00.352478 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-941eba96-7fe9-4173-b75d-83d0a7292948 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:00.352927 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-941eba96-7fe9-4173-b75d-83d0a7292948 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:00.353795 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-941eba96-7fe9-4173-b75d-83d0a7292948 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:00.354135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-941eba96-7fe9-4173-b75d-83d0a7292948 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:00.511345 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-941eba96-7fe9-4173-b75d-83d0a7292948 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:00.519752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-941eba96-7fe9-4173-b75d-83d0a7292948 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.176978 Jun 02 13:37:00.529700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 57/105] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:00 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:00.988494 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-291dcb41-4bff-47e2-8de5-da99f7149624 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:00.989274 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-291dcb41-4bff-47e2-8de5-da99f7149624 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:00.996119 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-291dcb41-4bff-47e2-8de5-da99f7149624 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:00.996605 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-291dcb41-4bff-47e2-8de5-da99f7149624 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:00.997384 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-291dcb41-4bff-47e2-8de5-da99f7149624 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:00.997833 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-291dcb41-4bff-47e2-8de5-da99f7149624 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:01.130843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-291dcb41-4bff-47e2-8de5-da99f7149624 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:01.139969 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-291dcb41-4bff-47e2-8de5-da99f7149624 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1321 microversion: 2.1 time: 0.155238 Jun 02 13:37:01.140795 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 58/106] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:00 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:01.203549 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-29ad1176-8b9e-4c8e-9664-08d91bd8b1a2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:01.204638 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-29ad1176-8b9e-4c8e-9664-08d91bd8b1a2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:01.213101 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-29ad1176-8b9e-4c8e-9664-08d91bd8b1a2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:01.214043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-29ad1176-8b9e-4c8e-9664-08d91bd8b1a2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:01.214823 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-29ad1176-8b9e-4c8e-9664-08d91bd8b1a2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:01.215256 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-29ad1176-8b9e-4c8e-9664-08d91bd8b1a2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:01.232174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:01.387155 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-29ad1176-8b9e-4c8e-9664-08d91bd8b1a2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:01.404633 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-29ad1176-8b9e-4c8e-9664-08d91bd8b1a2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:01.406361 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-29ad1176-8b9e-4c8e-9664-08d91bd8b1a2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:01.407603 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-29ad1176-8b9e-4c8e-9664-08d91bd8b1a2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.209185 Jun 02 13:37:01.408486 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 59/107] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:37:01 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:37:01.413124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-664e965a-1b6b-4c08-8694-b483f6c59f1f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:01.413725 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-664e965a-1b6b-4c08-8694-b483f6c59f1f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:01.419961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-664e965a-1b6b-4c08-8694-b483f6c59f1f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:01.420779 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-664e965a-1b6b-4c08-8694-b483f6c59f1f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:01.421997 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-664e965a-1b6b-4c08-8694-b483f6c59f1f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:01.422573 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-664e965a-1b6b-4c08-8694-b483f6c59f1f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:01.583826 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-664e965a-1b6b-4c08-8694-b483f6c59f1f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:01.593912 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-664e965a-1b6b-4c08-8694-b483f6c59f1f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.184170 Jun 02 13:37:01.604736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 60/108] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:01 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:01.610350 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-90981ddf-6d34-4548-a857-8309049d8fae tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:01.611083 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-90981ddf-6d34-4548-a857-8309049d8fae tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:01.619416 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90981ddf-6d34-4548-a857-8309049d8fae tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:01.620127 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90981ddf-6d34-4548-a857-8309049d8fae tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:01.621146 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90981ddf-6d34-4548-a857-8309049d8fae tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:01.621824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90981ddf-6d34-4548-a857-8309049d8fae tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:01.652765 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-679eeb90-776e-4e13-8ce3-515b7734e64e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "POST /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.064068 Jun 02 13:37:01.658628 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 49/109] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:36:59 2022] POST /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336/os-volume_attachments => generated 194 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:01.810111 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-90981ddf-6d34-4548-a857-8309049d8fae tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:01.819970 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-90981ddf-6d34-4548-a857-8309049d8fae tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.213826 Jun 02 13:37:01.820945 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 61/110] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:01 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:02.171097 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cec73c0d-f8bc-4821-9673-87a4e549d21f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:02.172472 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cec73c0d-f8bc-4821-9673-87a4e549d21f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:02.181093 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cec73c0d-f8bc-4821-9673-87a4e549d21f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.181781 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cec73c0d-f8bc-4821-9673-87a4e549d21f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.182851 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cec73c0d-f8bc-4821-9673-87a4e549d21f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.183406 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cec73c0d-f8bc-4821-9673-87a4e549d21f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.385972 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-26d2a583-101f-4b6f-8268-0f090dac671f req-12dad69f-cd23-402c-bdf9-b6a3fe3d9a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15208f-0bda-407c-8ea0-38a1300bfa16", "name": "network-vif-plugged", "status": "completed", "tag": "8aab5ca9-b3de-4176-a679-2976edeca505"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:37:02.392965 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:02.397351 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-26d2a583-101f-4b6f-8268-0f090dac671f req-12dad69f-cd23-402c-bdf9-b6a3fe3d9a7a service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.398363 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-26d2a583-101f-4b6f-8268-0f090dac671f req-12dad69f-cd23-402c-bdf9-b6a3fe3d9a7a service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.416893 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-26d2a583-101f-4b6f-8268-0f090dac671f req-12dad69f-cd23-402c-bdf9-b6a3fe3d9a7a service nova] Creating event network-vif-plugged:8aab5ca9-b3de-4176-a679-2976edeca505 for instance bf15208f-0bda-407c-8ea0-38a1300bfa16 on hv-cinder-83608 Jun 02 13:37:02.424105 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-26d2a583-101f-4b6f-8268-0f090dac671f req-12dad69f-cd23-402c-bdf9-b6a3fe3d9a7a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041984 Jun 02 13:37:02.426015 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cec73c0d-f8bc-4821-9673-87a4e549d21f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:02.427595 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 62/111] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:02.436459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cec73c0d-f8bc-4821-9673-87a4e549d21f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1516 microversion: 2.1 time: 0.281019 Jun 02 13:37:02.437035 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 50/112] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:02 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:02.446884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9a9cee09-c65d-45c2-8a67-7ed87085a6e7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:02.447616 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9a9cee09-c65d-45c2-8a67-7ed87085a6e7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:02.453984 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-458ef995-874d-4f2e-822b-72ee7d9e709a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:37:02.455000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-458ef995-874d-4f2e-822b-72ee7d9e709a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:02.471467 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9a9cee09-c65d-45c2-8a67-7ed87085a6e7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.472764 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9a9cee09-c65d-45c2-8a67-7ed87085a6e7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.479069 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9a9cee09-c65d-45c2-8a67-7ed87085a6e7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.480130 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9a9cee09-c65d-45c2-8a67-7ed87085a6e7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.486925 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-458ef995-874d-4f2e-822b-72ee7d9e709a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.487403 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-458ef995-874d-4f2e-822b-72ee7d9e709a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.490792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-458ef995-874d-4f2e-822b-72ee7d9e709a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.491258 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-458ef995-874d-4f2e-822b-72ee7d9e709a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.574670 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-458ef995-874d-4f2e-822b-72ee7d9e709a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lazy-loading 'flavor' on Instance uuid 236e7657-e603-49d7-bd47-12254338360f {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:37:02.659486 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:02.720512 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-458ef995-874d-4f2e-822b-72ee7d9e709a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f/action" status: 200 len: 32 microversion: 2.1 time: 0.270395 Jun 02 13:37:02.720965 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 51/113] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:37:02 2022] POST /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f/action => generated 32 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 13:37:02.737226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-79e9d985-b1b7-40a0-b7d0-13a622500d7b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:02.738058 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-79e9d985-b1b7-40a0-b7d0-13a622500d7b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:02.747652 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79e9d985-b1b7-40a0-b7d0-13a622500d7b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.748859 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79e9d985-b1b7-40a0-b7d0-13a622500d7b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.750599 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79e9d985-b1b7-40a0-b7d0-13a622500d7b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.751381 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9a9cee09-c65d-45c2-8a67-7ed87085a6e7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:02.752441 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79e9d985-b1b7-40a0-b7d0-13a622500d7b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.762201 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9a9cee09-c65d-45c2-8a67-7ed87085a6e7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:02.763759 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9a9cee09-c65d-45c2-8a67-7ed87085a6e7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:02.768184 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9a9cee09-c65d-45c2-8a67-7ed87085a6e7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.337273 Jun 02 13:37:02.768999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 63/114] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:37:02 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:37:02.778459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4be62f41-e87b-4810-9ca0-5283582a19a5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:02.779267 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4be62f41-e87b-4810-9ca0-5283582a19a5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:02.786132 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4be62f41-e87b-4810-9ca0-5283582a19a5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.786834 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4be62f41-e87b-4810-9ca0-5283582a19a5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.788217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4be62f41-e87b-4810-9ca0-5283582a19a5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:02.788682 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4be62f41-e87b-4810-9ca0-5283582a19a5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:02.989719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-79e9d985-b1b7-40a0-b7d0-13a622500d7b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:02.997681 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-79e9d985-b1b7-40a0-b7d0-13a622500d7b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1367 microversion: 2.1 time: 0.265458 Jun 02 13:37:02.998263 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 52/115] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:02 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:03.012664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-90913a12-9bcc-4072-925c-b27fb77ebf44 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:03.013510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-90913a12-9bcc-4072-925c-b27fb77ebf44 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:03.033324 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4be62f41-e87b-4810-9ca0-5283582a19a5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:03.039105 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90913a12-9bcc-4072-925c-b27fb77ebf44 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:03.039615 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90913a12-9bcc-4072-925c-b27fb77ebf44 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:03.040663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90913a12-9bcc-4072-925c-b27fb77ebf44 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:03.041123 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90913a12-9bcc-4072-925c-b27fb77ebf44 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:03.042586 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4be62f41-e87b-4810-9ca0-5283582a19a5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.267984 Jun 02 13:37:03.043187 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 64/116] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:02 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:03.252323 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-90913a12-9bcc-4072-925c-b27fb77ebf44 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:03.261230 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-90913a12-9bcc-4072-925c-b27fb77ebf44 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.252440 Jun 02 13:37:03.264504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 53/117] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:03 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:03.788719 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4e09c8ab-559b-41c2-a2d1-51d0c7763cbe tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:03.789354 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4e09c8ab-559b-41c2-a2d1-51d0c7763cbe tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:03.801596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e09c8ab-559b-41c2-a2d1-51d0c7763cbe tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:03.801596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e09c8ab-559b-41c2-a2d1-51d0c7763cbe tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:03.801596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e09c8ab-559b-41c2-a2d1-51d0c7763cbe tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:03.801596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e09c8ab-559b-41c2-a2d1-51d0c7763cbe tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:03.970770 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4e09c8ab-559b-41c2-a2d1-51d0c7763cbe tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:03.979887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4e09c8ab-559b-41c2-a2d1-51d0c7763cbe tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:03.981707 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4e09c8ab-559b-41c2-a2d1-51d0c7763cbe tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:03.982825 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4e09c8ab-559b-41c2-a2d1-51d0c7763cbe tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.199517 Jun 02 13:37:03.983387 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 65/118] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:37:03 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:37:04.015384 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5999197d-05f7-47ca-b383-c1e583dcab19 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:04.016002 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5999197d-05f7-47ca-b383-c1e583dcab19 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:04.026749 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5999197d-05f7-47ca-b383-c1e583dcab19 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:04.027202 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5999197d-05f7-47ca-b383-c1e583dcab19 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:04.027981 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5999197d-05f7-47ca-b383-c1e583dcab19 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:04.028455 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5999197d-05f7-47ca-b383-c1e583dcab19 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:04.064667 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7c28575b-c8c9-41e3-8ec8-54c4568da16a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:04.066316 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7c28575b-c8c9-41e3-8ec8-54c4568da16a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:04.074408 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7c28575b-c8c9-41e3-8ec8-54c4568da16a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:04.074923 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7c28575b-c8c9-41e3-8ec8-54c4568da16a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:04.076221 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7c28575b-c8c9-41e3-8ec8-54c4568da16a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:04.077214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7c28575b-c8c9-41e3-8ec8-54c4568da16a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:04.217382 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5999197d-05f7-47ca-b383-c1e583dcab19 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:04.226160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5999197d-05f7-47ca-b383-c1e583dcab19 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1557 microversion: 2.1 time: 0.215012 Jun 02 13:37:04.226954 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 54/119] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:04 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:04.259469 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7c28575b-c8c9-41e3-8ec8-54c4568da16a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:04.268179 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7c28575b-c8c9-41e3-8ec8-54c4568da16a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.208444 Jun 02 13:37:04.268886 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 66/120] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:04 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:04.280496 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f10c3b03-e7b5-4d62-8216-124175b56c11 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:04.281557 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f10c3b03-e7b5-4d62-8216-124175b56c11 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:04.283867 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-50cedf23-ee54-42f6-a4f8-753f550403dc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:04.284652 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-50cedf23-ee54-42f6-a4f8-753f550403dc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:04.289320 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f10c3b03-e7b5-4d62-8216-124175b56c11 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:04.290090 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f10c3b03-e7b5-4d62-8216-124175b56c11 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:04.291297 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f10c3b03-e7b5-4d62-8216-124175b56c11 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:04.291410 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-50cedf23-ee54-42f6-a4f8-753f550403dc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:04.292093 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f10c3b03-e7b5-4d62-8216-124175b56c11 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:04.293395 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-50cedf23-ee54-42f6-a4f8-753f550403dc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:04.294208 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-50cedf23-ee54-42f6-a4f8-753f550403dc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:04.294718 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-50cedf23-ee54-42f6-a4f8-753f550403dc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:04.406891 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f10c3b03-e7b5-4d62-8216-124175b56c11 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166958 Jun 02 13:37:04.407483 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 55/121] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Jun 2 13:37:04 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:37:04.476038 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-d4f7e4ba-fc86-412a-9eda-20d245f6b047 req-cf8061b8-18e8-48a1-96e1-79582154e763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ef14f4-ad83-4f47-bcf7-cd051e84dcef", "name": "network-vif-plugged", "status": "completed", "tag": "eae534a3-0e2b-44d2-90c9-88a5548068b2"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:37:04.485766 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-50cedf23-ee54-42f6-a4f8-753f550403dc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:04.491072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d4f7e4ba-fc86-412a-9eda-20d245f6b047 req-cf8061b8-18e8-48a1-96e1-79582154e763 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:04.495078 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d4f7e4ba-fc86-412a-9eda-20d245f6b047 req-cf8061b8-18e8-48a1-96e1-79582154e763 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:04.499237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-50cedf23-ee54-42f6-a4f8-753f550403dc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.221524 Jun 02 13:37:04.506434 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-d4f7e4ba-fc86-412a-9eda-20d245f6b047 req-cf8061b8-18e8-48a1-96e1-79582154e763 service nova] Creating event network-vif-plugged:eae534a3-0e2b-44d2-90c9-88a5548068b2 for instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef on hv-cinder-83608 Jun 02 13:37:04.510572 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 67/122] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:04 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:04.516619 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-d4f7e4ba-fc86-412a-9eda-20d245f6b047 req-cf8061b8-18e8-48a1-96e1-79582154e763 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041079 Jun 02 13:37:04.517702 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 56/123] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:37:05.005265 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a3864153-577d-4d6d-9772-3cc7b617c4d6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:05.006427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a3864153-577d-4d6d-9772-3cc7b617c4d6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:05.018851 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a3864153-577d-4d6d-9772-3cc7b617c4d6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:05.021775 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a3864153-577d-4d6d-9772-3cc7b617c4d6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:05.023037 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a3864153-577d-4d6d-9772-3cc7b617c4d6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:05.023682 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a3864153-577d-4d6d-9772-3cc7b617c4d6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:05.207529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a3864153-577d-4d6d-9772-3cc7b617c4d6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:05.226540 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a3864153-577d-4d6d-9772-3cc7b617c4d6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:05.228116 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a3864153-577d-4d6d-9772-3cc7b617c4d6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:05.229954 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a3864153-577d-4d6d-9772-3cc7b617c4d6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1407 microversion: 2.20 time: 0.230511 Jun 02 13:37:05.230756 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 68/124] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:37:04 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:37:05.287481 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ab4d6a6c-cc8c-4965-893f-56497608d05b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:05.288984 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ab4d6a6c-cc8c-4965-893f-56497608d05b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:05.299361 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab4d6a6c-cc8c-4965-893f-56497608d05b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:05.301177 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab4d6a6c-cc8c-4965-893f-56497608d05b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:05.302595 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab4d6a6c-cc8c-4965-893f-56497608d05b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:05.303466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab4d6a6c-cc8c-4965-893f-56497608d05b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:05.519580 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d8bffe72-7b36-4aba-aee0-24fb6a4c9e05 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:05.520513 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d8bffe72-7b36-4aba-aee0-24fb6a4c9e05 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:05.546398 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8bffe72-7b36-4aba-aee0-24fb6a4c9e05 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:05.546883 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8bffe72-7b36-4aba-aee0-24fb6a4c9e05 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:05.551325 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8bffe72-7b36-4aba-aee0-24fb6a4c9e05 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:05.552139 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8bffe72-7b36-4aba-aee0-24fb6a4c9e05 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:05.721071 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ab4d6a6c-cc8c-4965-893f-56497608d05b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:05.730627 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ab4d6a6c-cc8c-4965-893f-56497608d05b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.447851 Jun 02 13:37:05.731817 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 57/125] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:05 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:05.852739 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d8bffe72-7b36-4aba-aee0-24fb6a4c9e05 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:05.863540 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d8bffe72-7b36-4aba-aee0-24fb6a4c9e05 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.348248 Jun 02 13:37:05.865502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 69/126] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:05 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:06.046758 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-f00ced71-cf1b-4e49-b78c-010028301519 req-95881864-5cb0-4eb8-9860-35d4ecff4223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123ffac0-b1c6-4d56-a959-9dddf4e649c3", "tag": "ce43ce14-85b8-42b3-a50e-e16e10512b50"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:37:06.055422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-f00ced71-cf1b-4e49-b78c-010028301519 req-95881864-5cb0-4eb8-9860-35d4ecff4223 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:06.056113 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-f00ced71-cf1b-4e49-b78c-010028301519 req-95881864-5cb0-4eb8-9860-35d4ecff4223 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:06.067009 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-f00ced71-cf1b-4e49-b78c-010028301519 req-95881864-5cb0-4eb8-9860-35d4ecff4223 service nova] Creating event network-changed:ce43ce14-85b8-42b3-a50e-e16e10512b50 for instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 on hv-cinder-83608 Jun 02 13:37:06.072169 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-f00ced71-cf1b-4e49-b78c-010028301519 req-95881864-5cb0-4eb8-9860-35d4ecff4223 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029150 Jun 02 13:37:06.072817 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 58/127] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:06.249236 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3fef0d3a-fea3-438d-a4fd-c22ffad633d7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:06.250503 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3fef0d3a-fea3-438d-a4fd-c22ffad633d7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:06.258176 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3fef0d3a-fea3-438d-a4fd-c22ffad633d7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:06.258829 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3fef0d3a-fea3-438d-a4fd-c22ffad633d7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:06.260016 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3fef0d3a-fea3-438d-a4fd-c22ffad633d7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:06.260485 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3fef0d3a-fea3-438d-a4fd-c22ffad633d7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:06.424938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3fef0d3a-fea3-438d-a4fd-c22ffad633d7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:06.433987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3fef0d3a-fea3-438d-a4fd-c22ffad633d7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:06.437404 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3fef0d3a-fea3-438d-a4fd-c22ffad633d7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:06.440370 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3fef0d3a-fea3-438d-a4fd-c22ffad633d7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1599 microversion: 2.20 time: 0.195831 Jun 02 13:37:06.441716 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 70/128] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:37:06 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1599 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:37:06.462552 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2e3ab892-f0dc-4e01-a91a-efb7b0ddc13a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:06.463878 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2e3ab892-f0dc-4e01-a91a-efb7b0ddc13a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:06.470849 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2e3ab892-f0dc-4e01-a91a-efb7b0ddc13a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:06.471461 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2e3ab892-f0dc-4e01-a91a-efb7b0ddc13a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:06.472466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2e3ab892-f0dc-4e01-a91a-efb7b0ddc13a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:06.473089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2e3ab892-f0dc-4e01-a91a-efb7b0ddc13a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:06.569160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2e3ab892-f0dc-4e01-a91a-efb7b0ddc13a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.112528 Jun 02 13:37:06.570272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 59/129] 10.222.0.32 () {60 vars in 1315 bytes} [Thu Jun 2 13:37:06 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:37:06.749226 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-25b34eeb-2da2-4182-99fe-e389db448f9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:06.750005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-25b34eeb-2da2-4182-99fe-e389db448f9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:06.765937 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25b34eeb-2da2-4182-99fe-e389db448f9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:06.766863 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25b34eeb-2da2-4182-99fe-e389db448f9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:06.769032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25b34eeb-2da2-4182-99fe-e389db448f9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:06.772815 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25b34eeb-2da2-4182-99fe-e389db448f9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:06.884236 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c28a4ff4-5293-4139-8a1c-5f30c884da2d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:06.884975 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c28a4ff4-5293-4139-8a1c-5f30c884da2d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:06.887186 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:06.901292 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c28a4ff4-5293-4139-8a1c-5f30c884da2d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:06.904567 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c28a4ff4-5293-4139-8a1c-5f30c884da2d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:06.905762 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c28a4ff4-5293-4139-8a1c-5f30c884da2d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:06.906783 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c28a4ff4-5293-4139-8a1c-5f30c884da2d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:07.409545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-25b34eeb-2da2-4182-99fe-e389db448f9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:07.418316 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-25b34eeb-2da2-4182-99fe-e389db448f9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.673587 Jun 02 13:37:07.419074 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 71/130] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:06 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:07.431928 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c28a4ff4-5293-4139-8a1c-5f30c884da2d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:07.445022 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c28a4ff4-5293-4139-8a1c-5f30c884da2d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.566278 Jun 02 13:37:07.459153 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 60/131] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:06 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:08.406365 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-b0af94ed-ec17-4990-ac95-33aaaa955289 req-56993f34-a7c0-474a-a8f6-d56d2d6781cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf15208f-0bda-407c-8ea0-38a1300bfa16", "tag": "8aab5ca9-b3de-4176-a679-2976edeca505"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:37:08.415677 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-b0af94ed-ec17-4990-ac95-33aaaa955289 req-56993f34-a7c0-474a-a8f6-d56d2d6781cf service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:08.416222 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-b0af94ed-ec17-4990-ac95-33aaaa955289 req-56993f34-a7c0-474a-a8f6-d56d2d6781cf service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:08.429227 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-b0af94ed-ec17-4990-ac95-33aaaa955289 req-56993f34-a7c0-474a-a8f6-d56d2d6781cf service nova] Creating event network-changed:8aab5ca9-b3de-4176-a679-2976edeca505 for instance bf15208f-0bda-407c-8ea0-38a1300bfa16 on hv-cinder-83608 Jun 02 13:37:08.435200 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-07ba2e78-92e2-4e06-83b3-bfa2adb5d637 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:08.436345 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-07ba2e78-92e2-4e06-83b3-bfa2adb5d637 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:08.445967 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07ba2e78-92e2-4e06-83b3-bfa2adb5d637 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:08.446423 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07ba2e78-92e2-4e06-83b3-bfa2adb5d637 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:08.447200 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07ba2e78-92e2-4e06-83b3-bfa2adb5d637 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:08.447633 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07ba2e78-92e2-4e06-83b3-bfa2adb5d637 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:08.451919 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-b0af94ed-ec17-4990-ac95-33aaaa955289 req-56993f34-a7c0-474a-a8f6-d56d2d6781cf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048963 Jun 02 13:37:08.455788 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 72/132] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:08.465357 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9ca4ca5a-b4a4-4c69-b9f3-8ab482aa42b9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:08.466336 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9ca4ca5a-b4a4-4c69-b9f3-8ab482aa42b9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:08.472980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ca4ca5a-b4a4-4c69-b9f3-8ab482aa42b9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:08.473692 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ca4ca5a-b4a4-4c69-b9f3-8ab482aa42b9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:08.475225 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ca4ca5a-b4a4-4c69-b9f3-8ab482aa42b9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:08.475874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ca4ca5a-b4a4-4c69-b9f3-8ab482aa42b9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:08.680117 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9ca4ca5a-b4a4-4c69-b9f3-8ab482aa42b9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:08.695689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9ca4ca5a-b4a4-4c69-b9f3-8ab482aa42b9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.228576 Jun 02 13:37:08.696352 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 73/133] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:08 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:08.725874 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-07ba2e78-92e2-4e06-83b3-bfa2adb5d637 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:08.737211 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-07ba2e78-92e2-4e06-83b3-bfa2adb5d637 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.305884 Jun 02 13:37:08.738909 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 61/134] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:08 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:09.713260 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-beee2fdb-a1a8-4192-8e22-afae20109d91 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:09.713899 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-beee2fdb-a1a8-4192-8e22-afae20109d91 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:09.729757 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-beee2fdb-a1a8-4192-8e22-afae20109d91 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:09.730532 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-beee2fdb-a1a8-4192-8e22-afae20109d91 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:09.734969 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-beee2fdb-a1a8-4192-8e22-afae20109d91 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:09.735464 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-beee2fdb-a1a8-4192-8e22-afae20109d91 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:09.754899 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2c628753-4f07-4707-b9f6-f3651f7d7ae9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:09.756083 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2c628753-4f07-4707-b9f6-f3651f7d7ae9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:09.763316 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c628753-4f07-4707-b9f6-f3651f7d7ae9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:09.764062 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c628753-4f07-4707-b9f6-f3651f7d7ae9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:09.765089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c628753-4f07-4707-b9f6-f3651f7d7ae9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:09.765527 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c628753-4f07-4707-b9f6-f3651f7d7ae9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:10.040160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2c628753-4f07-4707-b9f6-f3651f7d7ae9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:10.042985 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-beee2fdb-a1a8-4192-8e22-afae20109d91 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:10.047925 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2c628753-4f07-4707-b9f6-f3651f7d7ae9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.296803 Jun 02 13:37:10.048626 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 62/135] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:09 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:10.051618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-beee2fdb-a1a8-4192-8e22-afae20109d91 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.343114 Jun 02 13:37:10.052872 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 74/136] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:09 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:11.068919 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f03ca1bb-f33e-43c1-9be3-1fea5ffade97 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:11.069424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3de41816-47cb-4648-b7ab-ce4ee5047543 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:11.070273 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3de41816-47cb-4648-b7ab-ce4ee5047543 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:11.070404 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f03ca1bb-f33e-43c1-9be3-1fea5ffade97 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:11.076625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3de41816-47cb-4648-b7ab-ce4ee5047543 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:11.077328 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3de41816-47cb-4648-b7ab-ce4ee5047543 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:11.078499 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3de41816-47cb-4648-b7ab-ce4ee5047543 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:11.079163 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3de41816-47cb-4648-b7ab-ce4ee5047543 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:11.079739 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f03ca1bb-f33e-43c1-9be3-1fea5ffade97 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:11.080506 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f03ca1bb-f33e-43c1-9be3-1fea5ffade97 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:11.081481 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f03ca1bb-f33e-43c1-9be3-1fea5ffade97 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:11.082077 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f03ca1bb-f33e-43c1-9be3-1fea5ffade97 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:11.278018 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3de41816-47cb-4648-b7ab-ce4ee5047543 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:11.286179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f03ca1bb-f33e-43c1-9be3-1fea5ffade97 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:11.303252 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f03ca1bb-f33e-43c1-9be3-1fea5ffade97 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.236020 Jun 02 13:37:11.303369 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3de41816-47cb-4648-b7ab-ce4ee5047543 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1363 microversion: 2.1 time: 0.235248 Jun 02 13:37:11.303369 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 75/137] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:11 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:11.303532 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 63/138] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:11 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:12.317652 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a0b963cf-b24a-4ffd-96ea-5e965ab91cb2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:12.318618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a0b963cf-b24a-4ffd-96ea-5e965ab91cb2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:12.320265 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6ea7f272-fea0-494a-a5d6-1c7b2299abd4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:12.321463 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6ea7f272-fea0-494a-a5d6-1c7b2299abd4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:12.325683 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0b963cf-b24a-4ffd-96ea-5e965ab91cb2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:12.326203 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0b963cf-b24a-4ffd-96ea-5e965ab91cb2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:12.327311 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0b963cf-b24a-4ffd-96ea-5e965ab91cb2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:12.327883 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0b963cf-b24a-4ffd-96ea-5e965ab91cb2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:12.328451 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ea7f272-fea0-494a-a5d6-1c7b2299abd4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:12.329045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ea7f272-fea0-494a-a5d6-1c7b2299abd4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:12.329956 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ea7f272-fea0-494a-a5d6-1c7b2299abd4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:12.330763 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6ea7f272-fea0-494a-a5d6-1c7b2299abd4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:12.650653 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6ea7f272-fea0-494a-a5d6-1c7b2299abd4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:12.652200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a0b963cf-b24a-4ffd-96ea-5e965ab91cb2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:12.665471 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a0b963cf-b24a-4ffd-96ea-5e965ab91cb2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1549 microversion: 2.1 time: 0.351806 Jun 02 13:37:12.670710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6ea7f272-fea0-494a-a5d6-1c7b2299abd4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.354420 Jun 02 13:37:12.671373 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 64/139] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:12 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:12.689087 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 76/140] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:12 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1549 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:12.704094 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b0f3f51-d39b-461d-8748-554ff377f926 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:12.704635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9b0f3f51-d39b-461d-8748-554ff377f926 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:12.711408 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b0f3f51-d39b-461d-8748-554ff377f926 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:12.711870 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b0f3f51-d39b-461d-8748-554ff377f926 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:12.712673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b0f3f51-d39b-461d-8748-554ff377f926 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:12.713113 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b0f3f51-d39b-461d-8748-554ff377f926 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:12.810609 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9b0f3f51-d39b-461d-8748-554ff377f926 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115463 Jun 02 13:37:12.811195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 65/141] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Jun 2 13:37:12 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:13.688647 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e487876a-4677-44b4-af41-6f2776ff790e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:13.690130 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e487876a-4677-44b4-af41-6f2776ff790e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:13.703755 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e487876a-4677-44b4-af41-6f2776ff790e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:13.704394 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e487876a-4677-44b4-af41-6f2776ff790e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:13.705981 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e487876a-4677-44b4-af41-6f2776ff790e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:13.706524 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e487876a-4677-44b4-af41-6f2776ff790e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:13.725875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:13.957539 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-fdde2d88-17ba-483e-9ad6-df9dda0833e7 req-919235c6-c80c-4b9a-a5a7-70fd9cd32a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ef14f4-ad83-4f47-bcf7-cd051e84dcef", "tag": "eae534a3-0e2b-44d2-90c9-88a5548068b2"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:37:13.966120 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-fdde2d88-17ba-483e-9ad6-df9dda0833e7 req-919235c6-c80c-4b9a-a5a7-70fd9cd32a9f service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:13.966863 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-fdde2d88-17ba-483e-9ad6-df9dda0833e7 req-919235c6-c80c-4b9a-a5a7-70fd9cd32a9f service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:13.969701 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e487876a-4677-44b4-af41-6f2776ff790e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:13.980456 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-fdde2d88-17ba-483e-9ad6-df9dda0833e7 req-919235c6-c80c-4b9a-a5a7-70fd9cd32a9f service nova] Creating event network-changed:eae534a3-0e2b-44d2-90c9-88a5548068b2 for instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef on hv-cinder-83608 Jun 02 13:37:13.982271 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e487876a-4677-44b4-af41-6f2776ff790e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.296742 Jun 02 13:37:13.992223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 77/142] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:13 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:13.996489 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-fdde2d88-17ba-483e-9ad6-df9dda0833e7 req-919235c6-c80c-4b9a-a5a7-70fd9cd32a9f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043194 Jun 02 13:37:13.997321 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 66/143] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:37:15.001704 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-783bdac3-a925-4f88-8472-e22e3a591316 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:15.003306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-783bdac3-a925-4f88-8472-e22e3a591316 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:15.011261 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-783bdac3-a925-4f88-8472-e22e3a591316 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:15.012096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-783bdac3-a925-4f88-8472-e22e3a591316 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:15.013182 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-783bdac3-a925-4f88-8472-e22e3a591316 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:15.014688 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-783bdac3-a925-4f88-8472-e22e3a591316 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:15.222845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-783bdac3-a925-4f88-8472-e22e3a591316 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:15.232137 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-783bdac3-a925-4f88-8472-e22e3a591316 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.236713 Jun 02 13:37:15.232950 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 78/144] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:14 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:16.250703 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3c6ed9ab-bc8f-491c-9882-cf1ff50f1b37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:16.251470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3c6ed9ab-bc8f-491c-9882-cf1ff50f1b37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:16.261916 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c6ed9ab-bc8f-491c-9882-cf1ff50f1b37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:16.262367 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c6ed9ab-bc8f-491c-9882-cf1ff50f1b37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:16.263133 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c6ed9ab-bc8f-491c-9882-cf1ff50f1b37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:16.263563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c6ed9ab-bc8f-491c-9882-cf1ff50f1b37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:16.406091 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3c6ed9ab-bc8f-491c-9882-cf1ff50f1b37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:16.413680 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3c6ed9ab-bc8f-491c-9882-cf1ff50f1b37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.167901 Jun 02 13:37:16.416347 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 67/145] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:16 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:16.736805 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-72e650b3-c385-4af8-8f3c-fb6c61243a58 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:16.737356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-72e650b3-c385-4af8-8f3c-fb6c61243a58 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:16.744867 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72e650b3-c385-4af8-8f3c-fb6c61243a58 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:16.745324 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72e650b3-c385-4af8-8f3c-fb6c61243a58 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:16.746094 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72e650b3-c385-4af8-8f3c-fb6c61243a58 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:16.746536 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72e650b3-c385-4af8-8f3c-fb6c61243a58 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:16.770759 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-72e650b3-c385-4af8-8f3c-fb6c61243a58 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:37:16.897453 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-72e650b3-c385-4af8-8f3c-fb6c61243a58 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "DELETE /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 204 len: 0 microversion: 2.1 time: 0.164186 Jun 02 13:37:16.898245 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 79/146] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:37:16 2022] DELETE /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:37:16.906309 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-864a2046-2940-4993-b3c9-6f00ef21acca tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:16.906960 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-864a2046-2940-4993-b3c9-6f00ef21acca tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:16.913485 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-864a2046-2940-4993-b3c9-6f00ef21acca tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:16.913932 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-864a2046-2940-4993-b3c9-6f00ef21acca tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:16.914695 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-864a2046-2940-4993-b3c9-6f00ef21acca tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:16.915127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-864a2046-2940-4993-b3c9-6f00ef21acca tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:17.049641 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-864a2046-2940-4993-b3c9-6f00ef21acca tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:17.058735 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-864a2046-2940-4993-b3c9-6f00ef21acca tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1553 microversion: 2.1 time: 0.156379 Jun 02 13:37:17.059548 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 68/147] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:16 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:17.430651 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-378c7e9f-f8dc-40cb-8fd4-a98a200f723f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:17.431348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-378c7e9f-f8dc-40cb-8fd4-a98a200f723f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:17.437277 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-378c7e9f-f8dc-40cb-8fd4-a98a200f723f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:17.437798 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-378c7e9f-f8dc-40cb-8fd4-a98a200f723f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:17.438567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-378c7e9f-f8dc-40cb-8fd4-a98a200f723f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:17.438999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-378c7e9f-f8dc-40cb-8fd4-a98a200f723f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:17.564964 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-378c7e9f-f8dc-40cb-8fd4-a98a200f723f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:17.573207 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-378c7e9f-f8dc-40cb-8fd4-a98a200f723f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.146644 Jun 02 13:37:17.573785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 80/148] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:17 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:18.078732 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-572ddb06-c8d2-42bd-8d8b-1a3e5a03fe16 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:18.079456 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-572ddb06-c8d2-42bd-8d8b-1a3e5a03fe16 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:18.086263 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-572ddb06-c8d2-42bd-8d8b-1a3e5a03fe16 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:18.086704 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-572ddb06-c8d2-42bd-8d8b-1a3e5a03fe16 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:18.087454 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-572ddb06-c8d2-42bd-8d8b-1a3e5a03fe16 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:18.087883 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-572ddb06-c8d2-42bd-8d8b-1a3e5a03fe16 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:18.214622 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-572ddb06-c8d2-42bd-8d8b-1a3e5a03fe16 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:18.222532 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-572ddb06-c8d2-42bd-8d8b-1a3e5a03fe16 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1553 microversion: 2.1 time: 0.147693 Jun 02 13:37:18.223094 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 69/149] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:18 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:18.590501 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-66f680ad-4217-43bb-b6a2-44ea9d058dd0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:18.591142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-66f680ad-4217-43bb-b6a2-44ea9d058dd0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:18.597154 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66f680ad-4217-43bb-b6a2-44ea9d058dd0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:18.597600 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66f680ad-4217-43bb-b6a2-44ea9d058dd0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:18.598373 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66f680ad-4217-43bb-b6a2-44ea9d058dd0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:18.598793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66f680ad-4217-43bb-b6a2-44ea9d058dd0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:18.721827 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-66f680ad-4217-43bb-b6a2-44ea9d058dd0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:18.729355 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-66f680ad-4217-43bb-b6a2-44ea9d058dd0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.142718 Jun 02 13:37:18.729925 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 81/150] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:18 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:19.238820 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0eeb9edc-e452-4662-bd3a-f2c341333f3e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:19.239459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0eeb9edc-e452-4662-bd3a-f2c341333f3e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:19.246484 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0eeb9edc-e452-4662-bd3a-f2c341333f3e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:19.246934 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0eeb9edc-e452-4662-bd3a-f2c341333f3e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:19.247693 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0eeb9edc-e452-4662-bd3a-f2c341333f3e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:19.248130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0eeb9edc-e452-4662-bd3a-f2c341333f3e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:19.269067 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:19.375818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0eeb9edc-e452-4662-bd3a-f2c341333f3e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:19.384369 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0eeb9edc-e452-4662-bd3a-f2c341333f3e tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1553 microversion: 2.1 time: 0.149335 Jun 02 13:37:19.384935 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 70/151] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:19 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:19.745987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-17866d7f-d940-4d9d-b943-80cf38ef794f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:19.746589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-17866d7f-d940-4d9d-b943-80cf38ef794f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:19.752532 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17866d7f-d940-4d9d-b943-80cf38ef794f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:19.752976 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17866d7f-d940-4d9d-b943-80cf38ef794f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:19.753727 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17866d7f-d940-4d9d-b943-80cf38ef794f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:19.754159 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17866d7f-d940-4d9d-b943-80cf38ef794f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:19.881638 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-17866d7f-d940-4d9d-b943-80cf38ef794f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:19.889009 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-17866d7f-d940-4d9d-b943-80cf38ef794f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.146752 Jun 02 13:37:19.889601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 82/152] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:19 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:20.400909 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-48d6ddca-c50b-4e19-b60a-a15de5cc8b3f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:20.401521 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-48d6ddca-c50b-4e19-b60a-a15de5cc8b3f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:20.407972 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48d6ddca-c50b-4e19-b60a-a15de5cc8b3f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:20.408464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48d6ddca-c50b-4e19-b60a-a15de5cc8b3f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:20.409228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48d6ddca-c50b-4e19-b60a-a15de5cc8b3f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:20.409669 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48d6ddca-c50b-4e19-b60a-a15de5cc8b3f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:20.532601 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-48d6ddca-c50b-4e19-b60a-a15de5cc8b3f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:20.540517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-48d6ddca-c50b-4e19-b60a-a15de5cc8b3f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1553 microversion: 2.1 time: 0.144173 Jun 02 13:37:20.541080 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 71/153] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:20 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1553 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:20.906006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-79fb7368-f02f-46ec-95b4-6312603bf805 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:20.906740 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-79fb7368-f02f-46ec-95b4-6312603bf805 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:20.912937 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-79fb7368-f02f-46ec-95b4-6312603bf805 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:20.913391 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-79fb7368-f02f-46ec-95b4-6312603bf805 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:20.914158 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-79fb7368-f02f-46ec-95b4-6312603bf805 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:20.914594 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-79fb7368-f02f-46ec-95b4-6312603bf805 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:21.256635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-79fb7368-f02f-46ec-95b4-6312603bf805 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:21.264060 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-79fb7368-f02f-46ec-95b4-6312603bf805 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.361875 Jun 02 13:37:21.264678 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 83/154] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:20 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:21.557070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1aa89053-d903-49d2-bb4c-e15f3f079010 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:21.557681 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1aa89053-d903-49d2-bb4c-e15f3f079010 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:21.564141 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1aa89053-d903-49d2-bb4c-e15f3f079010 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:21.564624 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1aa89053-d903-49d2-bb4c-e15f3f079010 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:21.565379 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1aa89053-d903-49d2-bb4c-e15f3f079010 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:21.565827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1aa89053-d903-49d2-bb4c-e15f3f079010 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:21.690945 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1aa89053-d903-49d2-bb4c-e15f3f079010 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:21.699324 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1aa89053-d903-49d2-bb4c-e15f3f079010 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1553 microversion: 2.1 time: 0.146073 Jun 02 13:37:21.699890 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 72/155] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:21 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:22.280093 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8aa513a9-6ac3-43b2-8911-8b4787c24157 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:22.280629 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8aa513a9-6ac3-43b2-8911-8b4787c24157 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:22.286571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8aa513a9-6ac3-43b2-8911-8b4787c24157 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:22.287045 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8aa513a9-6ac3-43b2-8911-8b4787c24157 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:22.287793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8aa513a9-6ac3-43b2-8911-8b4787c24157 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:22.288224 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8aa513a9-6ac3-43b2-8911-8b4787c24157 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:22.424293 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8aa513a9-6ac3-43b2-8911-8b4787c24157 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:22.433043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8aa513a9-6ac3-43b2-8911-8b4787c24157 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.156670 Jun 02 13:37:22.433626 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 84/156] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:22 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:22.716648 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-03124228-45e5-4c6b-ad96-577e37ea2fa9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:22.717261 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-03124228-45e5-4c6b-ad96-577e37ea2fa9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:22.723728 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03124228-45e5-4c6b-ad96-577e37ea2fa9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:22.724819 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03124228-45e5-4c6b-ad96-577e37ea2fa9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:22.725582 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03124228-45e5-4c6b-ad96-577e37ea2fa9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:22.726014 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03124228-45e5-4c6b-ad96-577e37ea2fa9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:22.854099 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-03124228-45e5-4c6b-ad96-577e37ea2fa9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:22.862056 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-03124228-45e5-4c6b-ad96-577e37ea2fa9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1553 microversion: 2.1 time: 0.149165 Jun 02 13:37:22.862625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 73/157] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:22 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:23.450147 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-10cd0438-a680-4aa9-9497-dab7ee9ef33d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:23.450794 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-10cd0438-a680-4aa9-9497-dab7ee9ef33d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:23.457114 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10cd0438-a680-4aa9-9497-dab7ee9ef33d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:23.457632 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10cd0438-a680-4aa9-9497-dab7ee9ef33d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:23.458459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10cd0438-a680-4aa9-9497-dab7ee9ef33d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:23.459474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10cd0438-a680-4aa9-9497-dab7ee9ef33d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:23.679145 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-10cd0438-a680-4aa9-9497-dab7ee9ef33d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:23.686555 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-10cd0438-a680-4aa9-9497-dab7ee9ef33d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.240394 Jun 02 13:37:23.687122 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 85/158] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:23 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:23.874970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-031302c1-5374-4947-ab9f-668c66e7ffe6 req-5ff3b5da-fcce-4179-8fd5-e66316d46bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26b39de5-4a0e-4232-840a-69b48be6b336", "name": "network-vif-deleted", "tag": "5cea31d6-3312-484a-b0a9-2d3fedd84f23"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:37:23.879004 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b58cb56f-4f6f-4900-8132-f31234b67ce9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:23.879620 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b58cb56f-4f6f-4900-8132-f31234b67ce9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:23.884750 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-031302c1-5374-4947-ab9f-668c66e7ffe6 req-5ff3b5da-fcce-4179-8fd5-e66316d46bf1 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:23.885274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-031302c1-5374-4947-ab9f-668c66e7ffe6 req-5ff3b5da-fcce-4179-8fd5-e66316d46bf1 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:23.886975 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b58cb56f-4f6f-4900-8132-f31234b67ce9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:23.887590 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b58cb56f-4f6f-4900-8132-f31234b67ce9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:23.888557 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b58cb56f-4f6f-4900-8132-f31234b67ce9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:23.888992 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b58cb56f-4f6f-4900-8132-f31234b67ce9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:23.896571 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-031302c1-5374-4947-ab9f-668c66e7ffe6 req-5ff3b5da-fcce-4179-8fd5-e66316d46bf1 service nova] Creating event network-vif-deleted:5cea31d6-3312-484a-b0a9-2d3fedd84f23 for instance 26b39de5-4a0e-4232-840a-69b48be6b336 on hv-cinder-83608 Jun 02 13:37:23.901526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-031302c1-5374-4947-ab9f-668c66e7ffe6 req-5ff3b5da-fcce-4179-8fd5-e66316d46bf1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030599 Jun 02 13:37:23.902117 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 74/159] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:23.953154 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b58cb56f-4f6f-4900-8132-f31234b67ce9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:23.968350 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b58cb56f-4f6f-4900-8132-f31234b67ce9 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1511 microversion: 2.1 time: 0.092893 Jun 02 13:37:23.968856 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 86/160] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:23 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1511 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:24.704366 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3d24e59c-dc87-4a98-9346-121d4df9a2c2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:24.705326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3d24e59c-dc87-4a98-9346-121d4df9a2c2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:24.712099 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3d24e59c-dc87-4a98-9346-121d4df9a2c2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:24.712576 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3d24e59c-dc87-4a98-9346-121d4df9a2c2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:24.713337 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3d24e59c-dc87-4a98-9346-121d4df9a2c2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:24.713776 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3d24e59c-dc87-4a98-9346-121d4df9a2c2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:24.846728 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3d24e59c-dc87-4a98-9346-121d4df9a2c2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:24.854180 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3d24e59c-dc87-4a98-9346-121d4df9a2c2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.154094 Jun 02 13:37:24.854746 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 75/161] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:24 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:24.985726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d3d0d27a-765c-48aa-9125-37c3e1ea3b14 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:24.986244 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d3d0d27a-765c-48aa-9125-37c3e1ea3b14 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:24.992217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d3d0d27a-765c-48aa-9125-37c3e1ea3b14 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:24.992694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d3d0d27a-765c-48aa-9125-37c3e1ea3b14 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:24.993447 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d3d0d27a-765c-48aa-9125-37c3e1ea3b14 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:24.993875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d3d0d27a-765c-48aa-9125-37c3e1ea3b14 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:25.053282 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d3d0d27a-765c-48aa-9125-37c3e1ea3b14 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:25.060986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d3d0d27a-765c-48aa-9125-37c3e1ea3b14 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1511 microversion: 2.1 time: 0.079189 Jun 02 13:37:25.061547 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 87/162] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:24 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1511 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:25.871119 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7056b56d-e3bd-48e5-b8d8-035a7be7066c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:25.871737 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7056b56d-e3bd-48e5-b8d8-035a7be7066c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:25.877913 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7056b56d-e3bd-48e5-b8d8-035a7be7066c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:25.878367 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7056b56d-e3bd-48e5-b8d8-035a7be7066c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:25.879136 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7056b56d-e3bd-48e5-b8d8-035a7be7066c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:25.879577 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7056b56d-e3bd-48e5-b8d8-035a7be7066c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:26.010178 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7056b56d-e3bd-48e5-b8d8-035a7be7066c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:26.017926 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7056b56d-e3bd-48e5-b8d8-035a7be7066c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.150541 Jun 02 13:37:26.018497 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 76/163] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:25 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:26.078961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c0f8f25a-b9b2-495b-b1d4-1a6649223e22 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:26.079499 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c0f8f25a-b9b2-495b-b1d4-1a6649223e22 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:26.085818 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c0f8f25a-b9b2-495b-b1d4-1a6649223e22 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:26.086263 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c0f8f25a-b9b2-495b-b1d4-1a6649223e22 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:26.087012 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c0f8f25a-b9b2-495b-b1d4-1a6649223e22 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:26.087441 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c0f8f25a-b9b2-495b-b1d4-1a6649223e22 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:26.149771 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c0f8f25a-b9b2-495b-b1d4-1a6649223e22 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:26.157730 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c0f8f25a-b9b2-495b-b1d4-1a6649223e22 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1345 microversion: 2.1 time: 0.082598 Jun 02 13:37:26.158285 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 88/164] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:26 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:27.034796 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-619dde84-914c-45e0-b361-dfcda9029d1e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:27.035415 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-619dde84-914c-45e0-b361-dfcda9029d1e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:27.042072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-619dde84-914c-45e0-b361-dfcda9029d1e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:27.042524 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-619dde84-914c-45e0-b361-dfcda9029d1e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:27.043280 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-619dde84-914c-45e0-b361-dfcda9029d1e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:27.043721 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-619dde84-914c-45e0-b361-dfcda9029d1e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:27.174199 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d80a5f2f-09ec-4f0a-85a5-3ec0fc009f56 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:27.174817 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d80a5f2f-09ec-4f0a-85a5-3ec0fc009f56 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:27.178618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-619dde84-914c-45e0-b361-dfcda9029d1e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:27.181108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d80a5f2f-09ec-4f0a-85a5-3ec0fc009f56 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:27.181561 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d80a5f2f-09ec-4f0a-85a5-3ec0fc009f56 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:27.182692 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d80a5f2f-09ec-4f0a-85a5-3ec0fc009f56 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:27.182790 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d80a5f2f-09ec-4f0a-85a5-3ec0fc009f56 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:27.191330 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-619dde84-914c-45e0-b361-dfcda9029d1e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.160281 Jun 02 13:37:27.193237 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 77/165] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:27 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:27.243758 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d80a5f2f-09ec-4f0a-85a5-3ec0fc009f56 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:27.252137 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d80a5f2f-09ec-4f0a-85a5-3ec0fc009f56 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1345 microversion: 2.1 time: 0.081758 Jun 02 13:37:27.252752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 89/166] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:27 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:28.209821 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e6cf9709-9bac-4cb0-b3e9-ea109c815371 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:28.210355 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e6cf9709-9bac-4cb0-b3e9-ea109c815371 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:28.216853 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6cf9709-9bac-4cb0-b3e9-ea109c815371 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:28.217284 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6cf9709-9bac-4cb0-b3e9-ea109c815371 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:28.218030 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6cf9709-9bac-4cb0-b3e9-ea109c815371 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:28.218466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6cf9709-9bac-4cb0-b3e9-ea109c815371 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:28.269645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:28.270257 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:28.278200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:28.278652 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:28.279421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:28.279894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:28.321454 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:28.322799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:28.324150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lazy-loading 'fault' on Instance uuid 26b39de5-4a0e-4232-840a-69b48be6b336 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:37:28.388990 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24621111433b47458b429fb7cd862b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28aead0a91684b0eb7fcdeace101cd1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:28.395364 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e6cf9709-9bac-4cb0-b3e9-ea109c815371 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:28.403822 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e6cf9709-9bac-4cb0-b3e9-ea109c815371 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.198738 Jun 02 13:37:28.406890 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bcf22f24-9e81-4780-8623-428c3c533fee tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 200 len: 1350 microversion: 2.1 time: 0.141323 Jun 02 13:37:28.416955 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 78/167] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:28 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:28.417594 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 90/168] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:28 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 1350 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:29.421527 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5f38ac12-2570-45bf-9734-fca5c994b0cc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:29.422177 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5f38ac12-2570-45bf-9734-fca5c994b0cc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:29.426027 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-45031d9c-2c10-49a9-8d14-3bd82e83a13a tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:29.426636 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-45031d9c-2c10-49a9-8d14-3bd82e83a13a tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:29.429568 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f38ac12-2570-45bf-9734-fca5c994b0cc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:29.430018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f38ac12-2570-45bf-9734-fca5c994b0cc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:29.430786 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f38ac12-2570-45bf-9734-fca5c994b0cc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:29.431225 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f38ac12-2570-45bf-9734-fca5c994b0cc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:29.433221 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45031d9c-2c10-49a9-8d14-3bd82e83a13a tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:29.433663 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45031d9c-2c10-49a9-8d14-3bd82e83a13a tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:29.434750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45031d9c-2c10-49a9-8d14-3bd82e83a13a tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:29.434934 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45031d9c-2c10-49a9-8d14-3bd82e83a13a tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:29.448448 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-45031d9c-2c10-49a9-8d14-3bd82e83a13a tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] HTTP exception thrown: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-45031d9c-2c10-49a9-8d14-3bd82e83a13a tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Request method failure captured: Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 HTTP/1.1 Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzLrZKo7xlIE7DLD4K6PXI43x7x8kK3oEISNlpToHFwvoEPF_eqTBKJ8unupezk_r-yC3ZmkrHK-eBE6cyJWCl87LzIGTaa_rZJ7EI3Y1SFF5Gxqu2NNC3JOH94dvZt_y9tlnhg2Qp_RVhhKBc92Rix7zd8ovBbHSE77ytKKc8YAx8 Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 28aead0a91684b0eb7fcdeace101cd1b Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:37:29.453125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/28aead0a91684b0eb7fcdeace101cd1b"}]}] Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 28aead0a91684b0eb7fcdeace101cd1b Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-DeleteServersTestJSON-1902292471-project Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 24621111433b47458b429fb7cd862b18 Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-DeleteServersTestJSON-1902292471-project Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:29.454294 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '26b39de5-4a0e-4232-840a-69b48be6b336'} Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:37:29.455323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:29.456450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:29.457402 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-45031d9c-2c10-49a9-8d14-3bd82e83a13a tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Returning 404 to user: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:37:29.457402 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-45031d9c-2c10-49a9-8d14-3bd82e83a13a tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 404 len: 111 microversion: 2.1 time: 0.032423 Jun 02 13:37:29.457402 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 91/169] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:29 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:37:29.565115 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5f38ac12-2570-45bf-9734-fca5c994b0cc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:29.567037 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-05db88d0-811c-4cb7-80ed-498091cd0a99 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:29.568063 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-05db88d0-811c-4cb7-80ed-498091cd0a99 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:29.573356 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5f38ac12-2570-45bf-9734-fca5c994b0cc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.155714 Jun 02 13:37:29.573928 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 79/170] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:29 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:29.574066 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-05db88d0-811c-4cb7-80ed-498091cd0a99 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:29.574517 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-05db88d0-811c-4cb7-80ed-498091cd0a99 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:29.575345 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-05db88d0-811c-4cb7-80ed-498091cd0a99 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:29.575782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-05db88d0-811c-4cb7-80ed-498091cd0a99 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:29.589357 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-05db88d0-811c-4cb7-80ed-498091cd0a99 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] HTTP exception thrown: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-05db88d0-811c-4cb7-80ed-498091cd0a99 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Request method failure captured: Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336/os-volume_attachments HTTP/1.1 Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzLrZKo7xlIE7DLD4K6PXI43x7x8kK3oEISNlpToHFwvoEPF_eqTBKJ8unupezk_r-yC3ZmkrHK-eBE6cyJWCl87LzIGTaa_rZJ7EI3Y1SFF5Gxqu2NNC3JOH94dvZt_y9tlnhg2Qp_RVhhKBc92Rix7zd8ovBbHSE77ytKKc8YAx8 Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 28aead0a91684b0eb7fcdeace101cd1b Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:37:29.590907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/28aead0a91684b0eb7fcdeace101cd1b"}]}] Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 28aead0a91684b0eb7fcdeace101cd1b Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-DeleteServersTestJSON-1902292471-project Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 24621111433b47458b429fb7cd862b18 Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-DeleteServersTestJSON-1902292471-project Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:29.592247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'server_id': '26b39de5-4a0e-4232-840a-69b48be6b336'} Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:37:29.593054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:29.594287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:29.595635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-05db88d0-811c-4cb7-80ed-498091cd0a99 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Returning 404 to user: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:37:29.595635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-05db88d0-811c-4cb7-80ed-498091cd0a99 tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029218 Jun 02 13:37:29.595635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 92/171] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:37:29 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:37:30.591933 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-18144457-30d9-4030-a2fa-8387b5655072 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:30.592657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-18144457-30d9-4030-a2fa-8387b5655072 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:30.599432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-18144457-30d9-4030-a2fa-8387b5655072 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:30.599880 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-18144457-30d9-4030-a2fa-8387b5655072 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:30.600667 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-18144457-30d9-4030-a2fa-8387b5655072 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:30.601099 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-18144457-30d9-4030-a2fa-8387b5655072 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:30.748114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-18144457-30d9-4030-a2fa-8387b5655072 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:30.755712 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-18144457-30d9-4030-a2fa-8387b5655072 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.169386 Jun 02 13:37:30.756283 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 80/172] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:30 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:30.794911 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-166f4a4f-24c0-46c1-83b1-ef030095e27f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:30.796839 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-166f4a4f-24c0-46c1-83b1-ef030095e27f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:30.804776 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-166f4a4f-24c0-46c1-83b1-ef030095e27f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:30.805266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-166f4a4f-24c0-46c1-83b1-ef030095e27f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:30.806458 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-166f4a4f-24c0-46c1-83b1-ef030095e27f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:30.807106 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-166f4a4f-24c0-46c1-83b1-ef030095e27f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:30.821986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-166f4a4f-24c0-46c1-83b1-ef030095e27f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] HTTP exception thrown: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-166f4a4f-24c0-46c1-83b1-ef030095e27f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Request method failure captured: Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 HTTP/1.1 Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzLrZKo7xlIE7DLD4K6PXI43x7x8kK3oEISNlpToHFwvoEPF_eqTBKJ8unupezk_r-yC3ZmkrHK-eBE6cyJWCl87LzIGTaa_rZJ7EI3Y1SFF5Gxqu2NNC3JOH94dvZt_y9tlnhg2Qp_RVhhKBc92Rix7zd8ovBbHSE77ytKKc8YAx8 Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 28aead0a91684b0eb7fcdeace101cd1b Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:37:30.823507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/28aead0a91684b0eb7fcdeace101cd1b"}]}] Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 28aead0a91684b0eb7fcdeace101cd1b Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-DeleteServersTestJSON-1902292471-project Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 24621111433b47458b429fb7cd862b18 Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-DeleteServersTestJSON-1902292471-project Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:30.824922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '26b39de5-4a0e-4232-840a-69b48be6b336'} Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:37:30.825624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:30.826661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:37:30.827783 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-166f4a4f-24c0-46c1-83b1-ef030095e27f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Returning 404 to user: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:37:30.827783 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-166f4a4f-24c0-46c1-83b1-ef030095e27f tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "DELETE /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 404 len: 111 microversion: 2.1 time: 0.035701 Jun 02 13:37:30.827783 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 93/173] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:37:30 2022] DELETE /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:37:30.834184 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f619b496-af9b-4aad-b7cf-700bbe86234c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:30.834853 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f619b496-af9b-4aad-b7cf-700bbe86234c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] [instance: 26b39de5-4a0e-4232-840a-69b48be6b336] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:30.844769 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f619b496-af9b-4aad-b7cf-700bbe86234c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:30.845292 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f619b496-af9b-4aad-b7cf-700bbe86234c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:30.846228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f619b496-af9b-4aad-b7cf-700bbe86234c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:30.846916 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f619b496-af9b-4aad-b7cf-700bbe86234c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:30.862333 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-f619b496-af9b-4aad-b7cf-700bbe86234c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] HTTP exception thrown: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f619b496-af9b-4aad-b7cf-700bbe86234c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Request method failure captured: Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 HTTP/1.1 Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzLrZKo7xlIE7DLD4K6PXI43x7x8kK3oEISNlpToHFwvoEPF_eqTBKJ8unupezk_r-yC3ZmkrHK-eBE6cyJWCl87LzIGTaa_rZJ7EI3Y1SFF5Gxqu2NNC3JOH94dvZt_y9tlnhg2Qp_RVhhKBc92Rix7zd8ovBbHSE77ytKKc8YAx8 Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 28aead0a91684b0eb7fcdeace101cd1b Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:37:30.867635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/28aead0a91684b0eb7fcdeace101cd1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/28aead0a91684b0eb7fcdeace101cd1b"}]}] Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 28aead0a91684b0eb7fcdeace101cd1b Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-DeleteServersTestJSON-1902292471 Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-DeleteServersTestJSON-1902292471-project Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 24621111433b47458b429fb7cd862b18 Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-DeleteServersTestJSON-1902292471-project Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:30.869698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '26b39de5-4a0e-4232-840a-69b48be6b336'} Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:37:30.872837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. Jun 02 13:37:30.873867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:37:30.874771 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f619b496-af9b-4aad-b7cf-700bbe86234c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] Returning 404 to user: Instance 26b39de5-4a0e-4232-840a-69b48be6b336 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:37:30.874771 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f619b496-af9b-4aad-b7cf-700bbe86234c tempest-DeleteServersTestJSON-1902292471 tempest-DeleteServersTestJSON-1902292471-project] 10.222.0.32 "GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336" status: 404 len: 111 microversion: 2.1 time: 0.039614 Jun 02 13:37:30.874771 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 81/174] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:30 2022] GET /compute/v2.1/servers/26b39de5-4a0e-4232-840a-69b48be6b336 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:37:31.773964 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-900c4029-0366-42d5-8c02-9e0535f7abff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:31.774648 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-900c4029-0366-42d5-8c02-9e0535f7abff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:31.780834 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-900c4029-0366-42d5-8c02-9e0535f7abff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:31.781351 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-900c4029-0366-42d5-8c02-9e0535f7abff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:31.782177 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-900c4029-0366-42d5-8c02-9e0535f7abff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:31.782697 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-900c4029-0366-42d5-8c02-9e0535f7abff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:31.786808 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:31.930680 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-900c4029-0366-42d5-8c02-9e0535f7abff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:31.940404 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-900c4029-0366-42d5-8c02-9e0535f7abff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.171080 Jun 02 13:37:31.941055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 94/175] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:31 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:32.957857 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d17a9845-c400-4222-b9a0-be747837cd10 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:32.958598 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d17a9845-c400-4222-b9a0-be747837cd10 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:32.965782 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d17a9845-c400-4222-b9a0-be747837cd10 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:32.966241 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d17a9845-c400-4222-b9a0-be747837cd10 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:32.967003 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d17a9845-c400-4222-b9a0-be747837cd10 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:32.967439 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d17a9845-c400-4222-b9a0-be747837cd10 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:33.096689 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d17a9845-c400-4222-b9a0-be747837cd10 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:33.104119 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d17a9845-c400-4222-b9a0-be747837cd10 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.150355 Jun 02 13:37:33.104811 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 82/176] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:32 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:34.121008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2292d522-48c8-49cf-a9cd-f681404bc47a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:34.121620 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2292d522-48c8-49cf-a9cd-f681404bc47a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:34.123544 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:34.129076 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2292d522-48c8-49cf-a9cd-f681404bc47a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:34.129524 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2292d522-48c8-49cf-a9cd-f681404bc47a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:34.130281 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2292d522-48c8-49cf-a9cd-f681404bc47a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:34.130722 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2292d522-48c8-49cf-a9cd-f681404bc47a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:34.257495 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2292d522-48c8-49cf-a9cd-f681404bc47a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:34.264970 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2292d522-48c8-49cf-a9cd-f681404bc47a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.147937 Jun 02 13:37:34.272498 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 95/177] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:34 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:35.282174 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8d2307b8-0c07-4880-ab1a-2f6865932bcc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:35.283005 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8d2307b8-0c07-4880-ab1a-2f6865932bcc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:35.290288 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8d2307b8-0c07-4880-ab1a-2f6865932bcc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:35.290742 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8d2307b8-0c07-4880-ab1a-2f6865932bcc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:35.291518 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8d2307b8-0c07-4880-ab1a-2f6865932bcc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:35.291960 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8d2307b8-0c07-4880-ab1a-2f6865932bcc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:35.417617 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8d2307b8-0c07-4880-ab1a-2f6865932bcc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:35.425063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8d2307b8-0c07-4880-ab1a-2f6865932bcc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.146875 Jun 02 13:37:35.425628 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 83/178] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:35 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:36.442374 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-53c0d591-c6fb-43bb-b397-a74436b7bc05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:36.443014 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-53c0d591-c6fb-43bb-b397-a74436b7bc05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:36.448895 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-53c0d591-c6fb-43bb-b397-a74436b7bc05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:36.449343 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-53c0d591-c6fb-43bb-b397-a74436b7bc05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:36.450104 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-53c0d591-c6fb-43bb-b397-a74436b7bc05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:36.450585 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-53c0d591-c6fb-43bb-b397-a74436b7bc05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:36.599206 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-53c0d591-c6fb-43bb-b397-a74436b7bc05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:36.610124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-53c0d591-c6fb-43bb-b397-a74436b7bc05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.171721 Jun 02 13:37:36.611337 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 96/179] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:36 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:37.133687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8ec9a4e1-5db9-4439-88db-c1631d6b270d tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f86151ab550>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:37.181268 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8ec9a4e1-5db9-4439-88db-c1631d6b270d tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/cef43883-1095-4ca3-bd5c-08aaacdb794d" status: 200 len: 350 microversion: 2.1 time: 0.051872 Jun 02 13:37:37.181936 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 84/180] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:37:37 2022] GET /compute/v2.1/os-volumes/cef43883-1095-4ca3-bd5c-08aaacdb794d => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:37.626770 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cc17e458-b0ba-4f95-b72b-f5a9e593449d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:37.627385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cc17e458-b0ba-4f95-b72b-f5a9e593449d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:37.633545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc17e458-b0ba-4f95-b72b-f5a9e593449d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:37.633996 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc17e458-b0ba-4f95-b72b-f5a9e593449d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:37.634760 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc17e458-b0ba-4f95-b72b-f5a9e593449d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:37.635199 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc17e458-b0ba-4f95-b72b-f5a9e593449d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:37.761781 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cc17e458-b0ba-4f95-b72b-f5a9e593449d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:37.769161 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cc17e458-b0ba-4f95-b72b-f5a9e593449d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.146219 Jun 02 13:37:37.769738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 97/181] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:37 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:38.497256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3f71a433-4130-4db5-8a49-99724408df91 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f8615195940>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:38.543975 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3f71a433-4130-4db5-8a49-99724408df91 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/42e779c2-780e-4b0a-a797-d53f63674db8" status: 200 len: 350 microversion: 2.1 time: 0.050925 Jun 02 13:37:38.544617 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 85/182] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:37:38 2022] GET /compute/v2.1/os-volumes/42e779c2-780e-4b0a-a797-d53f63674db8 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:38.785734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d778ee6c-f489-419a-be7c-95f3f55c8d75 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:38.786954 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d778ee6c-f489-419a-be7c-95f3f55c8d75 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:38.795512 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d778ee6c-f489-419a-be7c-95f3f55c8d75 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:38.796135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d778ee6c-f489-419a-be7c-95f3f55c8d75 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:38.797125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d778ee6c-f489-419a-be7c-95f3f55c8d75 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:38.797724 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d778ee6c-f489-419a-be7c-95f3f55c8d75 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:38.948325 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d778ee6c-f489-419a-be7c-95f3f55c8d75 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:38.955969 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d778ee6c-f489-419a-be7c-95f3f55c8d75 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.174135 Jun 02 13:37:38.956570 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 98/183] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:38 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:39.906036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4d23e4ca-21d3-4bf2-964b-42a5e9301a64 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f86151b2ca0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:39.966108 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4d23e4ca-21d3-4bf2-964b-42a5e9301a64 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/a2931344-7eb5-4db8-9751-a5f7ed323936" status: 200 len: 351 microversion: 2.1 time: 0.064391 Jun 02 13:37:39.966852 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 86/184] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:37:39 2022] GET /compute/v2.1/os-volumes/a2931344-7eb5-4db8-9751-a5f7ed323936 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:39.973269 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1255d9de-2042-4cf2-bd28-30fb7221ea50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:39.974450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1255d9de-2042-4cf2-bd28-30fb7221ea50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:39.978082 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-82a4a284-7ca8-4ce7-978f-70c19623dd8c tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f8615195b80>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:39.981301 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1255d9de-2042-4cf2-bd28-30fb7221ea50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:39.981695 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1255d9de-2042-4cf2-bd28-30fb7221ea50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:39.982493 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1255d9de-2042-4cf2-bd28-30fb7221ea50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:39.982929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1255d9de-2042-4cf2-bd28-30fb7221ea50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:40.067697 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-82a4a284-7ca8-4ce7-978f-70c19623dd8c tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092871 Jun 02 13:37:40.068257 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 87/185] 10.222.0.32 () {58 vars in 1133 bytes} [Thu Jun 2 13:37:39 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:40.081823 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5817adaf-9f03-4862-852a-5afce83258ee tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f86153089d0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:40.152792 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1255d9de-2042-4cf2-bd28-30fb7221ea50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:40.160882 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1255d9de-2042-4cf2-bd28-30fb7221ea50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.191700 Jun 02 13:37:40.162179 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 99/186] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:39 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:40.165195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5817adaf-9f03-4862-852a-5afce83258ee tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088825 Jun 02 13:37:40.165756 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 88/187] 10.222.0.32 () {58 vars in 1148 bytes} [Thu Jun 2 13:37:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:37:40.177894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f0121f51-3e2e-43ac-91e1-a53f5c12d650 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f8615239940>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:40.261928 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f0121f51-3e2e-43ac-91e1-a53f5c12d650 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088164 Jun 02 13:37:40.262478 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 100/188] 10.222.0.32 () {58 vars in 1133 bytes} [Thu Jun 2 13:37:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:40.273563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-70826f97-b726-49a7-a064-4682bf9bdf30 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f861529eb80>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:40.360525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-70826f97-b726-49a7-a064-4682bf9bdf30 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090712 Jun 02 13:37:40.361131 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 89/189] 10.222.0.32 () {58 vars in 1166 bytes} [Thu Jun 2 13:37:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:40.373608 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-774ede1e-ba4d-448e-8320-45b83f28225e tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f8615228af0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:40.465793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-774ede1e-ba4d-448e-8320-45b83f28225e tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096369 Jun 02 13:37:40.466361 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 101/190] 10.222.0.32 () {58 vars in 1169 bytes} [Thu Jun 2 13:37:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:40.478476 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0edfc8d7-9dd6-4ef0-8dba-6c0f5c6b2674 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f861529e430>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:40.562379 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0edfc8d7-9dd6-4ef0-8dba-6c0f5c6b2674 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087524 Jun 02 13:37:40.563466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 90/191] 10.222.0.32 () {58 vars in 1154 bytes} [Thu Jun 2 13:37:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:40.574937 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-752a836d-2455-4c3f-ae44-3e163369d14e tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f86152349d0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:40.658371 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-752a836d-2455-4c3f-ae44-3e163369d14e tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087075 Jun 02 13:37:40.658938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 102/192] 10.222.0.32 () {58 vars in 1187 bytes} [Thu Jun 2 13:37:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:37:40.670790 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9e2aec68-550f-483e-bf11-9e6b67ca50f0 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] Calling method '.version_select at 0x7f8615308ee0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:40.751927 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9e2aec68-550f-483e-bf11-9e6b67ca50f0 tempest-VolumesTestJSON-468830065 tempest-VolumesTestJSON-468830065-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084832 Jun 02 13:37:40.752537 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 91/193] 10.222.0.32 () {58 vars in 1154 bytes} [Thu Jun 2 13:37:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:41.179444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-85d0b9cb-f462-4999-a3fa-4efc45ac45f9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:41.180722 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-85d0b9cb-f462-4999-a3fa-4efc45ac45f9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:41.187686 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85d0b9cb-f462-4999-a3fa-4efc45ac45f9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:41.188349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85d0b9cb-f462-4999-a3fa-4efc45ac45f9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:41.189384 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85d0b9cb-f462-4999-a3fa-4efc45ac45f9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:41.189832 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85d0b9cb-f462-4999-a3fa-4efc45ac45f9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:41.334894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-85d0b9cb-f462-4999-a3fa-4efc45ac45f9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:41.342491 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-85d0b9cb-f462-4999-a3fa-4efc45ac45f9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.167575 Jun 02 13:37:41.343052 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 103/194] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:41 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:42.360860 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-50e2aa1e-9b35-4072-a24d-781e14c3b2fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:42.362114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-50e2aa1e-9b35-4072-a24d-781e14c3b2fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:42.365096 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=48 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:42.371701 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50e2aa1e-9b35-4072-a24d-781e14c3b2fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:42.372534 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50e2aa1e-9b35-4072-a24d-781e14c3b2fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:42.373426 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50e2aa1e-9b35-4072-a24d-781e14c3b2fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:42.374317 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50e2aa1e-9b35-4072-a24d-781e14c3b2fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:42.533813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-50e2aa1e-9b35-4072-a24d-781e14c3b2fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:42.547063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-50e2aa1e-9b35-4072-a24d-781e14c3b2fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.191822 Jun 02 13:37:42.548048 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 92/195] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:42 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:43.564164 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-834a34f0-8a71-4da1-b8af-925186f95bb4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:43.565507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-834a34f0-8a71-4da1-b8af-925186f95bb4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:43.571508 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-834a34f0-8a71-4da1-b8af-925186f95bb4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:43.571952 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-834a34f0-8a71-4da1-b8af-925186f95bb4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:43.572736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-834a34f0-8a71-4da1-b8af-925186f95bb4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:43.573169 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-834a34f0-8a71-4da1-b8af-925186f95bb4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:43.707725 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-834a34f0-8a71-4da1-b8af-925186f95bb4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:43.716136 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-834a34f0-8a71-4da1-b8af-925186f95bb4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.155956 Jun 02 13:37:43.716739 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 104/196] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:43 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:44.734912 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9c33192f-8ecf-4e20-89ce-7d42a6f8de46 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:44.735600 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9c33192f-8ecf-4e20-89ce-7d42a6f8de46 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:44.742836 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c33192f-8ecf-4e20-89ce-7d42a6f8de46 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:44.743287 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c33192f-8ecf-4e20-89ce-7d42a6f8de46 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:44.744065 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c33192f-8ecf-4e20-89ce-7d42a6f8de46 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:44.744535 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c33192f-8ecf-4e20-89ce-7d42a6f8de46 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:44.882963 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9c33192f-8ecf-4e20-89ce-7d42a6f8de46 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:44.891700 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9c33192f-8ecf-4e20-89ce-7d42a6f8de46 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.161519 Jun 02 13:37:44.892379 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 93/197] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:44 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:45.908013 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bc180a33-2b0b-46d5-8d13-7eba6fb805dc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:45.909269 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bc180a33-2b0b-46d5-8d13-7eba6fb805dc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:45.915772 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc180a33-2b0b-46d5-8d13-7eba6fb805dc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:45.916227 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc180a33-2b0b-46d5-8d13-7eba6fb805dc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:45.917032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc180a33-2b0b-46d5-8d13-7eba6fb805dc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:45.917533 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc180a33-2b0b-46d5-8d13-7eba6fb805dc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:46.054433 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bc180a33-2b0b-46d5-8d13-7eba6fb805dc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:46.062019 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bc180a33-2b0b-46d5-8d13-7eba6fb805dc tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.157710 Jun 02 13:37:46.062665 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 105/198] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:45 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:47.078855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3cb0c233-5e97-46f8-a4e1-1eb30d3c970a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:47.079553 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3cb0c233-5e97-46f8-a4e1-1eb30d3c970a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:47.086487 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3cb0c233-5e97-46f8-a4e1-1eb30d3c970a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:47.087014 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3cb0c233-5e97-46f8-a4e1-1eb30d3c970a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:47.087868 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3cb0c233-5e97-46f8-a4e1-1eb30d3c970a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:47.088411 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3cb0c233-5e97-46f8-a4e1-1eb30d3c970a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:47.220953 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3cb0c233-5e97-46f8-a4e1-1eb30d3c970a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:47.229069 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3cb0c233-5e97-46f8-a4e1-1eb30d3c970a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.154104 Jun 02 13:37:47.229638 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 94/199] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:47 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:48.247437 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-25d56c75-55e9-48a4-b831-1ea3ba3cd6cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:48.248671 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-25d56c75-55e9-48a4-b831-1ea3ba3cd6cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:48.255750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25d56c75-55e9-48a4-b831-1ea3ba3cd6cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:48.256426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25d56c75-55e9-48a4-b831-1ea3ba3cd6cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:48.257740 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25d56c75-55e9-48a4-b831-1ea3ba3cd6cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:48.258729 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25d56c75-55e9-48a4-b831-1ea3ba3cd6cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:48.407922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-25d56c75-55e9-48a4-b831-1ea3ba3cd6cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:48.416469 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-25d56c75-55e9-48a4-b831-1ea3ba3cd6cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.172809 Jun 02 13:37:48.417405 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 106/200] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:48 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:49.435391 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1234d4d5-be39-4c17-b2eb-2c97e1f7a4b2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:49.436016 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1234d4d5-be39-4c17-b2eb-2c97e1f7a4b2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:49.444041 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1234d4d5-be39-4c17-b2eb-2c97e1f7a4b2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:49.444932 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1234d4d5-be39-4c17-b2eb-2c97e1f7a4b2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:49.446028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1234d4d5-be39-4c17-b2eb-2c97e1f7a4b2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:49.446654 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1234d4d5-be39-4c17-b2eb-2c97e1f7a4b2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:49.463226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=92 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:37:49.615854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1234d4d5-be39-4c17-b2eb-2c97e1f7a4b2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:49.620421 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1234d4d5-be39-4c17-b2eb-2c97e1f7a4b2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.189555 Jun 02 13:37:49.621810 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 95/201] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:49 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:50.644029 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-15f6ff57-b349-427f-a3f5-72c2f59b25b6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:50.644779 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-15f6ff57-b349-427f-a3f5-72c2f59b25b6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:50.651262 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-15f6ff57-b349-427f-a3f5-72c2f59b25b6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:50.651721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-15f6ff57-b349-427f-a3f5-72c2f59b25b6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:50.652542 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-15f6ff57-b349-427f-a3f5-72c2f59b25b6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:50.652987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-15f6ff57-b349-427f-a3f5-72c2f59b25b6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:50.807323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-15f6ff57-b349-427f-a3f5-72c2f59b25b6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:50.815077 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-15f6ff57-b349-427f-a3f5-72c2f59b25b6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.180742 Jun 02 13:37:50.815736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 107/202] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:50 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:51.833241 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-555c2142-0afd-4446-8a2b-76c0805b5bbe tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:51.834109 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-555c2142-0afd-4446-8a2b-76c0805b5bbe tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:51.842412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-555c2142-0afd-4446-8a2b-76c0805b5bbe tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:51.842880 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-555c2142-0afd-4446-8a2b-76c0805b5bbe tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:51.843660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-555c2142-0afd-4446-8a2b-76c0805b5bbe tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:51.844157 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-555c2142-0afd-4446-8a2b-76c0805b5bbe tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:51.984251 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-555c2142-0afd-4446-8a2b-76c0805b5bbe tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:51.992266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-555c2142-0afd-4446-8a2b-76c0805b5bbe tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.163748 Jun 02 13:37:51.992989 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 96/203] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:51 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:53.009500 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c6b3afc7-2c46-40d4-9591-aa16eda6cc99 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:53.010289 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c6b3afc7-2c46-40d4-9591-aa16eda6cc99 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:53.016548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6b3afc7-2c46-40d4-9591-aa16eda6cc99 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:53.017223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6b3afc7-2c46-40d4-9591-aa16eda6cc99 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:53.018055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6b3afc7-2c46-40d4-9591-aa16eda6cc99 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:53.018497 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6b3afc7-2c46-40d4-9591-aa16eda6cc99 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:53.147796 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c6b3afc7-2c46-40d4-9591-aa16eda6cc99 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:53.164951 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c6b3afc7-2c46-40d4-9591-aa16eda6cc99 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.159380 Jun 02 13:37:53.165758 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 108/204] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:53 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:54.180838 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ab5ade78-b46b-404a-8a21-108e07d58385 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:54.181516 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ab5ade78-b46b-404a-8a21-108e07d58385 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:54.188064 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab5ade78-b46b-404a-8a21-108e07d58385 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:54.188550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab5ade78-b46b-404a-8a21-108e07d58385 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:54.189316 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab5ade78-b46b-404a-8a21-108e07d58385 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:54.189806 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab5ade78-b46b-404a-8a21-108e07d58385 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:54.336793 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ab5ade78-b46b-404a-8a21-108e07d58385 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:54.344227 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ab5ade78-b46b-404a-8a21-108e07d58385 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.167213 Jun 02 13:37:54.344822 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 97/205] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:54 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:55.366568 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9ad7850e-72ad-41a9-9520-d7666ef7b08b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:55.367506 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9ad7850e-72ad-41a9-9520-d7666ef7b08b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:55.374981 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ad7850e-72ad-41a9-9520-d7666ef7b08b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:55.375479 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ad7850e-72ad-41a9-9520-d7666ef7b08b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:55.376252 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ad7850e-72ad-41a9-9520-d7666ef7b08b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:55.376905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ad7850e-72ad-41a9-9520-d7666ef7b08b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:55.532757 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9ad7850e-72ad-41a9-9520-d7666ef7b08b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:55.541849 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9ad7850e-72ad-41a9-9520-d7666ef7b08b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.183005 Jun 02 13:37:55.544467 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 109/206] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:55 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:56.558811 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-461689f0-3fbb-43c7-b1c7-2996ba4033cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:56.559521 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-461689f0-3fbb-43c7-b1c7-2996ba4033cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:56.566038 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-461689f0-3fbb-43c7-b1c7-2996ba4033cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:56.567079 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-461689f0-3fbb-43c7-b1c7-2996ba4033cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:56.567920 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-461689f0-3fbb-43c7-b1c7-2996ba4033cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:56.568484 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-461689f0-3fbb-43c7-b1c7-2996ba4033cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:56.807083 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-461689f0-3fbb-43c7-b1c7-2996ba4033cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:56.817647 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-461689f0-3fbb-43c7-b1c7-2996ba4033cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.261136 Jun 02 13:37:56.824640 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 98/207] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:56 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:57.830902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d85b167a-7e5c-4dd1-939d-caf8a1fe4135 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:57.831520 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d85b167a-7e5c-4dd1-939d-caf8a1fe4135 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:57.838248 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d85b167a-7e5c-4dd1-939d-caf8a1fe4135 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:57.838703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d85b167a-7e5c-4dd1-939d-caf8a1fe4135 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:57.839477 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d85b167a-7e5c-4dd1-939d-caf8a1fe4135 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:57.840033 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d85b167a-7e5c-4dd1-939d-caf8a1fe4135 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:57.972349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d85b167a-7e5c-4dd1-939d-caf8a1fe4135 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:57.979675 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d85b167a-7e5c-4dd1-939d-caf8a1fe4135 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.152818 Jun 02 13:37:57.980274 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 110/208] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:57 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:37:58.596719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-817884478", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "networks": [{"uuid": "6dc744f7-ccc0-4556-972f-b3b64d2e2c9e"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:37:58.650359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] validate_networks() for [('6dc744f7-ccc0-4556-972f-b3b64d2e2c9e', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:37:58.995318 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:37:58.995854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:37:58.996348 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:37:58.996768 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:37:58.997203 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:37:59.000703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6d031aae-6181-4a27-81a9-e2c609d3e543 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:59.002395 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6d031aae-6181-4a27-81a9-e2c609d3e543 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:59.007040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:59.007752 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:59.008894 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:59.009466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:59.021403 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d031aae-6181-4a27-81a9-e2c609d3e543 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:59.021900 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d031aae-6181-4a27-81a9-e2c609d3e543 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:59.022916 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d031aae-6181-4a27-81a9-e2c609d3e543 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:37:59.023363 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d031aae-6181-4a27-81a9-e2c609d3e543 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:37:59.027760 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Getting quotas for project 46301efc51224c3db7660777fac426b2. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:37:59.032378 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Getting quotas for user 2351177553054eeebc4c60abcfecfa70 and project 46301efc51224c3db7660777fac426b2. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:37:59.044689 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:37:59.046872 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:37:59.101185 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1d0421a3-8222-47ef-bc4e-06a9e5b600b0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508289 Jun 02 13:37:59.101820 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 99/209] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:37:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:37:59.111604 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-843f25c1-78bd-4257-8cff-0a0a7a302855 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:37:59.112215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-843f25c1-78bd-4257-8cff-0a0a7a302855 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:37:59.182613 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-843f25c1-78bd-4257-8cff-0a0a7a302855 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:59.195296 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-843f25c1-78bd-4257-8cff-0a0a7a302855 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1213 microversion: 2.1 time: 0.086497 Jun 02 13:37:59.196012 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 100/210] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:59 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:37:59.208742 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6d031aae-6181-4a27-81a9-e2c609d3e543 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:37:59.216699 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6d031aae-6181-4a27-81a9-e2c609d3e543 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.222260 Jun 02 13:37:59.217265 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 111/211] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:37:58 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:00.212096 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ba3e1e18-83b5-47a9-8226-5810264351d3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:00.212738 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ba3e1e18-83b5-47a9-8226-5810264351d3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:00.218820 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba3e1e18-83b5-47a9-8226-5810264351d3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:00.219268 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba3e1e18-83b5-47a9-8226-5810264351d3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:00.220028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba3e1e18-83b5-47a9-8226-5810264351d3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:00.220503 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba3e1e18-83b5-47a9-8226-5810264351d3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:00.232898 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-398bf031-e14c-4f76-b3a2-7c3d7070e80a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:00.233506 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-398bf031-e14c-4f76-b3a2-7c3d7070e80a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:00.239331 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-398bf031-e14c-4f76-b3a2-7c3d7070e80a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:00.239795 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-398bf031-e14c-4f76-b3a2-7c3d7070e80a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:00.240645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-398bf031-e14c-4f76-b3a2-7c3d7070e80a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:00.241084 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-398bf031-e14c-4f76-b3a2-7c3d7070e80a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:00.281928 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ba3e1e18-83b5-47a9-8226-5810264351d3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:00.289603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ba3e1e18-83b5-47a9-8226-5810264351d3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1217 microversion: 2.1 time: 0.081471 Jun 02 13:38:00.290170 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 101/212] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:00 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:00.373698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-398bf031-e14c-4f76-b3a2-7c3d7070e80a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:00.381768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-398bf031-e14c-4f76-b3a2-7c3d7070e80a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.152578 Jun 02 13:38:00.382329 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 112/213] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:00 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:01.306174 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6e82c11c-e6f2-4454-8a17-ee97be73669b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:01.306783 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6e82c11c-e6f2-4454-8a17-ee97be73669b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:01.313271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6e82c11c-e6f2-4454-8a17-ee97be73669b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:01.313713 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6e82c11c-e6f2-4454-8a17-ee97be73669b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:01.314463 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6e82c11c-e6f2-4454-8a17-ee97be73669b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:01.314892 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6e82c11c-e6f2-4454-8a17-ee97be73669b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:01.377101 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6e82c11c-e6f2-4454-8a17-ee97be73669b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:01.384765 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6e82c11c-e6f2-4454-8a17-ee97be73669b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1217 microversion: 2.1 time: 0.082384 Jun 02 13:38:01.385310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 102/214] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:01 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:01.398378 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-547385f7-b67b-4d79-b230-76e5da280bd5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:01.399118 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-547385f7-b67b-4d79-b230-76e5da280bd5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:01.405207 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-547385f7-b67b-4d79-b230-76e5da280bd5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:01.405660 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-547385f7-b67b-4d79-b230-76e5da280bd5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:01.406427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-547385f7-b67b-4d79-b230-76e5da280bd5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:01.406871 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-547385f7-b67b-4d79-b230-76e5da280bd5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:01.530282 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-547385f7-b67b-4d79-b230-76e5da280bd5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:01.532516 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:01.539634 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-547385f7-b67b-4d79-b230-76e5da280bd5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.145497 Jun 02 13:38:01.540203 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 113/215] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:01 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:02.401238 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7995932f-cc41-48a6-890e-abb1f62f1178 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:02.401844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7995932f-cc41-48a6-890e-abb1f62f1178 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:02.414600 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7995932f-cc41-48a6-890e-abb1f62f1178 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:02.415160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7995932f-cc41-48a6-890e-abb1f62f1178 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:02.415977 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7995932f-cc41-48a6-890e-abb1f62f1178 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:02.416487 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7995932f-cc41-48a6-890e-abb1f62f1178 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:02.479715 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7995932f-cc41-48a6-890e-abb1f62f1178 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:02.491353 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7995932f-cc41-48a6-890e-abb1f62f1178 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1217 microversion: 2.1 time: 0.093755 Jun 02 13:38:02.497465 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 103/216] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:02 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:02.557495 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-77ee9ef5-184c-4e1f-8bce-88962a80e62f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:02.558135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-77ee9ef5-184c-4e1f-8bce-88962a80e62f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:02.564894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77ee9ef5-184c-4e1f-8bce-88962a80e62f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:02.565416 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77ee9ef5-184c-4e1f-8bce-88962a80e62f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:02.566445 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77ee9ef5-184c-4e1f-8bce-88962a80e62f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:02.567035 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77ee9ef5-184c-4e1f-8bce-88962a80e62f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:02.962632 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-77ee9ef5-184c-4e1f-8bce-88962a80e62f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:02.971452 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-77ee9ef5-184c-4e1f-8bce-88962a80e62f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.417850 Jun 02 13:38:02.981398 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 114/217] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:02 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:03.508477 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5993fefe-b661-4b38-8a2c-e96c7a9009bd tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:03.509143 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5993fefe-b661-4b38-8a2c-e96c7a9009bd tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:03.515687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5993fefe-b661-4b38-8a2c-e96c7a9009bd tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:03.516140 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5993fefe-b661-4b38-8a2c-e96c7a9009bd tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:03.516939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5993fefe-b661-4b38-8a2c-e96c7a9009bd tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:03.517376 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5993fefe-b661-4b38-8a2c-e96c7a9009bd tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:03.582385 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5993fefe-b661-4b38-8a2c-e96c7a9009bd tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:03.590341 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5993fefe-b661-4b38-8a2c-e96c7a9009bd tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1265 microversion: 2.1 time: 0.086223 Jun 02 13:38:03.591102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 104/218] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:03 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:03.988582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-51c7f8a6-3ffe-4bd8-960f-f732b05a608f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:03.989412 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-51c7f8a6-3ffe-4bd8-960f-f732b05a608f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:03.996502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51c7f8a6-3ffe-4bd8-960f-f732b05a608f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:03.997114 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51c7f8a6-3ffe-4bd8-960f-f732b05a608f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:03.997916 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51c7f8a6-3ffe-4bd8-960f-f732b05a608f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:03.998370 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51c7f8a6-3ffe-4bd8-960f-f732b05a608f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:04.144830 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-51c7f8a6-3ffe-4bd8-960f-f732b05a608f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:04.152158 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-51c7f8a6-3ffe-4bd8-960f-f732b05a608f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1522 microversion: 2.1 time: 0.167435 Jun 02 13:38:04.152752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 115/219] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:03 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:04.608050 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6faddcf6-6128-4fbc-87a8-77210fc8e962 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:04.608691 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6faddcf6-6128-4fbc-87a8-77210fc8e962 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:04.616358 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6faddcf6-6128-4fbc-87a8-77210fc8e962 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:04.618085 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6faddcf6-6128-4fbc-87a8-77210fc8e962 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:04.619276 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6faddcf6-6128-4fbc-87a8-77210fc8e962 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:04.620647 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6faddcf6-6128-4fbc-87a8-77210fc8e962 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:04.702716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6faddcf6-6128-4fbc-87a8-77210fc8e962 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:04.711591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6faddcf6-6128-4fbc-87a8-77210fc8e962 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1271 microversion: 2.1 time: 0.107384 Jun 02 13:38:04.712543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 105/220] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:04 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:05.168091 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c413a439-0aee-4d2c-b324-04ef2c19e7a4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:05.169569 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c413a439-0aee-4d2c-b324-04ef2c19e7a4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:05.171539 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=36 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:05.177538 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c413a439-0aee-4d2c-b324-04ef2c19e7a4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:05.178260 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c413a439-0aee-4d2c-b324-04ef2c19e7a4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:05.179270 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c413a439-0aee-4d2c-b324-04ef2c19e7a4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:05.179711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c413a439-0aee-4d2c-b324-04ef2c19e7a4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:05.341035 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c413a439-0aee-4d2c-b324-04ef2c19e7a4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:05.348837 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c413a439-0aee-4d2c-b324-04ef2c19e7a4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1502 microversion: 2.1 time: 0.184421 Jun 02 13:38:05.349231 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 116/221] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:05 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:05.365962 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ab9eb3fa-cf68-4b5a-b868-b4aac68dc095 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:05.366701 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ab9eb3fa-cf68-4b5a-b868-b4aac68dc095 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:05.373048 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab9eb3fa-cf68-4b5a-b868-b4aac68dc095 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:05.373539 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab9eb3fa-cf68-4b5a-b868-b4aac68dc095 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:05.374422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab9eb3fa-cf68-4b5a-b868-b4aac68dc095 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:05.374875 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab9eb3fa-cf68-4b5a-b868-b4aac68dc095 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:05.510420 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ab9eb3fa-cf68-4b5a-b868-b4aac68dc095 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:05.517930 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ab9eb3fa-cf68-4b5a-b868-b4aac68dc095 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1515 microversion: 2.1 time: 0.157273 Jun 02 13:38:05.518491 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 106/222] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:05 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:05.738051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1507bcb4-46b4-480f-a89b-bb1b19f75e55 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:05.738689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1507bcb4-46b4-480f-a89b-bb1b19f75e55 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:05.746472 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1507bcb4-46b4-480f-a89b-bb1b19f75e55 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:05.748036 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1507bcb4-46b4-480f-a89b-bb1b19f75e55 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:05.748881 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1507bcb4-46b4-480f-a89b-bb1b19f75e55 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:05.749350 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1507bcb4-46b4-480f-a89b-bb1b19f75e55 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:06.033541 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1507bcb4-46b4-480f-a89b-bb1b19f75e55 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:06.051029 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1507bcb4-46b4-480f-a89b-bb1b19f75e55 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1313 microversion: 2.1 time: 0.325596 Jun 02 13:38:06.052611 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 117/223] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:05 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:06.700332 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-d4149116-6079-43a8-8dfd-c64347f4ce08 req-ee71d401-db1d-4ace-8030-e2d2573b6b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3", "tag": "f41257d2-499c-4ffa-bdcb-68057c448a28"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:06.717648 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d4149116-6079-43a8-8dfd-c64347f4ce08 req-ee71d401-db1d-4ace-8030-e2d2573b6b80 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:06.719151 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d4149116-6079-43a8-8dfd-c64347f4ce08 req-ee71d401-db1d-4ace-8030-e2d2573b6b80 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:06.755905 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-d4149116-6079-43a8-8dfd-c64347f4ce08 req-ee71d401-db1d-4ace-8030-e2d2573b6b80 service nova] Creating event network-changed:f41257d2-499c-4ffa-bdcb-68057c448a28 for instance 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 on hv-cinder-83608 Jun 02 13:38:06.763372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-d4149116-6079-43a8-8dfd-c64347f4ce08 req-ee71d401-db1d-4ace-8030-e2d2573b6b80 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071044 Jun 02 13:38:06.764917 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 107/224] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:06.966010 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ff653d00-7958-405a-b76e-ac543d1f8e50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:06.971745 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ff653d00-7958-405a-b76e-ac543d1f8e50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:06.979585 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff653d00-7958-405a-b76e-ac543d1f8e50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:06.981200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff653d00-7958-405a-b76e-ac543d1f8e50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:06.982704 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff653d00-7958-405a-b76e-ac543d1f8e50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:06.983319 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff653d00-7958-405a-b76e-ac543d1f8e50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:07.013663 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-ff653d00-7958-405a-b76e-ac543d1f8e50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lazy-loading 'flavor' on Instance uuid c82cda25-d51b-490e-9102-3de1f9b9066b {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:38:07.074054 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8479ed67-b670-4cd3-8d0e-af97949472a3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:07.075685 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8479ed67-b670-4cd3-8d0e-af97949472a3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:07.090325 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8479ed67-b670-4cd3-8d0e-af97949472a3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:07.092499 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8479ed67-b670-4cd3-8d0e-af97949472a3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:07.095779 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8479ed67-b670-4cd3-8d0e-af97949472a3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:07.096284 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8479ed67-b670-4cd3-8d0e-af97949472a3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:07.183276 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ff653d00-7958-405a-b76e-ac543d1f8e50 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b/action" status: 200 len: 32 microversion: 2.1 time: 0.221162 Jun 02 13:38:07.183889 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 118/225] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:38:06 2022] POST /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b/action => generated 32 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:38:07.194269 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-07bb088e-ddab-451c-9a53-66192c1ebf95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:07.194994 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-07bb088e-ddab-451c-9a53-66192c1ebf95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:07.205401 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-07bb088e-ddab-451c-9a53-66192c1ebf95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:07.206224 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-07bb088e-ddab-451c-9a53-66192c1ebf95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:07.207650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-07bb088e-ddab-451c-9a53-66192c1ebf95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:07.208417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-07bb088e-ddab-451c-9a53-66192c1ebf95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:07.566552 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-07bb088e-ddab-451c-9a53-66192c1ebf95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:07.589315 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-07bb088e-ddab-451c-9a53-66192c1ebf95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.399597 Jun 02 13:38:07.590143 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 119/226] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:07 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:07.598427 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8479ed67-b670-4cd3-8d0e-af97949472a3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:07.606968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8479ed67-b670-4cd3-8d0e-af97949472a3 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1313 microversion: 2.1 time: 0.541104 Jun 02 13:38:07.607559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 108/227] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:07 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:08.607252 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-32fffc4d-9264-4e0a-8593-042729200d8b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:08.607861 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-32fffc4d-9264-4e0a-8593-042729200d8b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:08.621110 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32fffc4d-9264-4e0a-8593-042729200d8b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:08.622375 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32fffc4d-9264-4e0a-8593-042729200d8b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:08.623295 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-26089346-d61e-4d38-b54e-5b0911cdb55d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:08.623915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-26089346-d61e-4d38-b54e-5b0911cdb55d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:08.625197 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32fffc4d-9264-4e0a-8593-042729200d8b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:08.626631 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32fffc4d-9264-4e0a-8593-042729200d8b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:08.632086 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-26089346-d61e-4d38-b54e-5b0911cdb55d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:08.643412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-26089346-d61e-4d38-b54e-5b0911cdb55d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:08.649385 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-26089346-d61e-4d38-b54e-5b0911cdb55d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:08.649933 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-26089346-d61e-4d38-b54e-5b0911cdb55d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:08.995657 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-32fffc4d-9264-4e0a-8593-042729200d8b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:09.003643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-32fffc4d-9264-4e0a-8593-042729200d8b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.400177 Jun 02 13:38:09.018330 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:09.019434 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 120/228] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:08 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:09.107818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-26089346-d61e-4d38-b54e-5b0911cdb55d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:09.118377 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-26089346-d61e-4d38-b54e-5b0911cdb55d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1313 microversion: 2.1 time: 0.498684 Jun 02 13:38:09.127480 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 109/229] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:08 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:10.022700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e9fe8315-957c-4a5f-8d88-d5cb2f890e6e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:10.024008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e9fe8315-957c-4a5f-8d88-d5cb2f890e6e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:10.030357 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9fe8315-957c-4a5f-8d88-d5cb2f890e6e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:10.031127 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9fe8315-957c-4a5f-8d88-d5cb2f890e6e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:10.032103 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9fe8315-957c-4a5f-8d88-d5cb2f890e6e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:10.032732 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9fe8315-957c-4a5f-8d88-d5cb2f890e6e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:10.135072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f5ba2261-5ce4-4495-a8dd-94d793e75883 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:10.136058 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f5ba2261-5ce4-4495-a8dd-94d793e75883 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:10.143645 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=8 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:10.148102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5ba2261-5ce4-4495-a8dd-94d793e75883 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:10.148656 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5ba2261-5ce4-4495-a8dd-94d793e75883 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:10.149511 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5ba2261-5ce4-4495-a8dd-94d793e75883 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:10.149952 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5ba2261-5ce4-4495-a8dd-94d793e75883 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:10.392577 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e9fe8315-957c-4a5f-8d88-d5cb2f890e6e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:10.401036 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e9fe8315-957c-4a5f-8d88-d5cb2f890e6e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.382560 Jun 02 13:38:10.410306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 121/230] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:10 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:10.499359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f5ba2261-5ce4-4495-a8dd-94d793e75883 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:10.525253 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f5ba2261-5ce4-4495-a8dd-94d793e75883 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1313 microversion: 2.1 time: 0.389743 Jun 02 13:38:10.527976 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 110/231] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:10 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:11.418407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-93b96673-a29d-402c-91a2-99ae303d1888 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:11.419121 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-93b96673-a29d-402c-91a2-99ae303d1888 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:11.425077 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-93b96673-a29d-402c-91a2-99ae303d1888 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:11.425756 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-93b96673-a29d-402c-91a2-99ae303d1888 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:11.427062 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-93b96673-a29d-402c-91a2-99ae303d1888 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:11.427505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-93b96673-a29d-402c-91a2-99ae303d1888 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:11.545445 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f081ae6d-b412-4510-967e-6df66a58c7a2 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:11.546049 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f081ae6d-b412-4510-967e-6df66a58c7a2 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:11.553580 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f081ae6d-b412-4510-967e-6df66a58c7a2 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:11.554033 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f081ae6d-b412-4510-967e-6df66a58c7a2 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:11.554810 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f081ae6d-b412-4510-967e-6df66a58c7a2 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:11.555249 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f081ae6d-b412-4510-967e-6df66a58c7a2 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:11.807459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-93b96673-a29d-402c-91a2-99ae303d1888 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:11.816637 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-93b96673-a29d-402c-91a2-99ae303d1888 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.401707 Jun 02 13:38:11.818355 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 122/232] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:11 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:11.854849 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f081ae6d-b412-4510-967e-6df66a58c7a2 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:11.877154 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f081ae6d-b412-4510-967e-6df66a58c7a2 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1313 microversion: 2.1 time: 0.335451 Jun 02 13:38:11.878409 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 111/233] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:11 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:12.836318 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ca76b6bd-49a2-4bef-9123-fa80c7a5dd04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:12.837421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ca76b6bd-49a2-4bef-9123-fa80c7a5dd04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:12.843519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca76b6bd-49a2-4bef-9123-fa80c7a5dd04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:12.843974 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca76b6bd-49a2-4bef-9123-fa80c7a5dd04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:12.846237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca76b6bd-49a2-4bef-9123-fa80c7a5dd04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:12.846237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca76b6bd-49a2-4bef-9123-fa80c7a5dd04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:12.901578 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c4aa7462-a446-4527-b8fc-b5e59257a09e tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:12.902941 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c4aa7462-a446-4527-b8fc-b5e59257a09e tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:12.908890 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:12.910716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4aa7462-a446-4527-b8fc-b5e59257a09e tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:12.911351 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4aa7462-a446-4527-b8fc-b5e59257a09e tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:12.912489 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4aa7462-a446-4527-b8fc-b5e59257a09e tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:12.913082 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4aa7462-a446-4527-b8fc-b5e59257a09e tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:13.097904 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ca76b6bd-49a2-4bef-9123-fa80c7a5dd04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:13.109338 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ca76b6bd-49a2-4bef-9123-fa80c7a5dd04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.278009 Jun 02 13:38:13.110773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 123/234] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:12 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:13.135218 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c4aa7462-a446-4527-b8fc-b5e59257a09e tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:13.143609 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c4aa7462-a446-4527-b8fc-b5e59257a09e tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1313 microversion: 2.1 time: 0.245878 Jun 02 13:38:13.154175 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 112/235] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:12 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:14.129819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d13b190b-bf22-4e4f-a427-f655e15d2167 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:14.130961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d13b190b-bf22-4e4f-a427-f655e15d2167 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:14.141130 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d13b190b-bf22-4e4f-a427-f655e15d2167 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:14.141574 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d13b190b-bf22-4e4f-a427-f655e15d2167 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:14.142534 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d13b190b-bf22-4e4f-a427-f655e15d2167 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:14.143138 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d13b190b-bf22-4e4f-a427-f655e15d2167 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:14.162021 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-15fd5e8a-1981-4758-84b2-8bef3045dcf0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:14.163195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-15fd5e8a-1981-4758-84b2-8bef3045dcf0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:14.179800 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-15fd5e8a-1981-4758-84b2-8bef3045dcf0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:14.180275 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-15fd5e8a-1981-4758-84b2-8bef3045dcf0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:14.181088 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-15fd5e8a-1981-4758-84b2-8bef3045dcf0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:14.181534 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-15fd5e8a-1981-4758-84b2-8bef3045dcf0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:14.413592 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-15fd5e8a-1981-4758-84b2-8bef3045dcf0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:14.423385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d13b190b-bf22-4e4f-a427-f655e15d2167 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:14.430026 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-15fd5e8a-1981-4758-84b2-8bef3045dcf0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1313 microversion: 2.1 time: 0.272990 Jun 02 13:38:14.430627 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 113/236] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:14 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:14.434740 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d13b190b-bf22-4e4f-a427-f655e15d2167 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.309834 Jun 02 13:38:14.445024 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 124/237] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:14 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:15.203574 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-5453db66-faa3-46c9-a4ba-b4e9c7ec968e req-c9c4705d-528e-4d52-9c8a-62f6279e4065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3", "name": "network-vif-plugged", "status": "completed", "tag": "f41257d2-499c-4ffa-bdcb-68057c448a28"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:15.214458 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-5453db66-faa3-46c9-a4ba-b4e9c7ec968e req-c9c4705d-528e-4d52-9c8a-62f6279e4065 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:15.214913 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-5453db66-faa3-46c9-a4ba-b4e9c7ec968e req-c9c4705d-528e-4d52-9c8a-62f6279e4065 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:15.217843 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:15.242152 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-5453db66-faa3-46c9-a4ba-b4e9c7ec968e req-c9c4705d-528e-4d52-9c8a-62f6279e4065 service nova] Creating event network-vif-plugged:f41257d2-499c-4ffa-bdcb-68057c448a28 for instance 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 on hv-cinder-83608 Jun 02 13:38:15.251215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-5453db66-faa3-46c9-a4ba-b4e9c7ec968e req-c9c4705d-528e-4d52-9c8a-62f6279e4065 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054392 Jun 02 13:38:15.252116 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 114/238] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:15.458053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b7288cca-46f6-4786-89d0-c670af21e20a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:15.458805 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b7288cca-46f6-4786-89d0-c670af21e20a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:15.460688 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-18daf146-75b8-4370-9377-fe9fd9a7ed69 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:15.463112 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-18daf146-75b8-4370-9377-fe9fd9a7ed69 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:15.484489 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b7288cca-46f6-4786-89d0-c670af21e20a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:15.484896 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b7288cca-46f6-4786-89d0-c670af21e20a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:15.486879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-18daf146-75b8-4370-9377-fe9fd9a7ed69 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:15.487509 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-18daf146-75b8-4370-9377-fe9fd9a7ed69 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:15.487945 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b7288cca-46f6-4786-89d0-c670af21e20a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:15.494611 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-18daf146-75b8-4370-9377-fe9fd9a7ed69 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:15.495064 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b7288cca-46f6-4786-89d0-c670af21e20a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:15.495684 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-18daf146-75b8-4370-9377-fe9fd9a7ed69 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:15.942934 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-18daf146-75b8-4370-9377-fe9fd9a7ed69 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:15.971578 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b7288cca-46f6-4786-89d0-c670af21e20a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:15.975534 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-18daf146-75b8-4370-9377-fe9fd9a7ed69 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1313 microversion: 2.1 time: 0.510783 Jun 02 13:38:15.978108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 125/239] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:15 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:15.990032 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b7288cca-46f6-4786-89d0-c670af21e20a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.539484 Jun 02 13:38:15.990792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 115/240] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:15 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:16.997217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-23c95c47-82ff-415b-ac66-5c7ae9688f7b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:16.998971 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-23c95c47-82ff-415b-ac66-5c7ae9688f7b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:17.009616 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-70cb070d-ebdd-4277-88f4-19427ddd6f37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:17.010943 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-70cb070d-ebdd-4277-88f4-19427ddd6f37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:17.032964 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-23c95c47-82ff-415b-ac66-5c7ae9688f7b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:17.041433 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70cb070d-ebdd-4277-88f4-19427ddd6f37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:17.042073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-23c95c47-82ff-415b-ac66-5c7ae9688f7b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:17.043695 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-23c95c47-82ff-415b-ac66-5c7ae9688f7b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:17.045034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70cb070d-ebdd-4277-88f4-19427ddd6f37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:17.045731 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-23c95c47-82ff-415b-ac66-5c7ae9688f7b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:17.046838 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70cb070d-ebdd-4277-88f4-19427ddd6f37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:17.051763 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70cb070d-ebdd-4277-88f4-19427ddd6f37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:17.476924 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-23c95c47-82ff-415b-ac66-5c7ae9688f7b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:17.489474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-23c95c47-82ff-415b-ac66-5c7ae9688f7b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1313 microversion: 2.1 time: 0.497493 Jun 02 13:38:17.491684 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 126/241] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:16 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:17.567810 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70cb070d-ebdd-4277-88f4-19427ddd6f37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:17.578357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-70cb070d-ebdd-4277-88f4-19427ddd6f37 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.575021 Jun 02 13:38:17.579826 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 116/242] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:17 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:18.509819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7594e81b-84d2-4941-afd0-d9c713a281fe tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:18.510344 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7594e81b-84d2-4941-afd0-d9c713a281fe tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:18.521593 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7594e81b-84d2-4941-afd0-d9c713a281fe tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:18.522043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7594e81b-84d2-4941-afd0-d9c713a281fe tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:18.523057 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7594e81b-84d2-4941-afd0-d9c713a281fe tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:18.523495 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7594e81b-84d2-4941-afd0-d9c713a281fe tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:18.597275 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3a8cea8d-bd35-457f-8ed7-7e1cbf13bbfb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:18.598614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3a8cea8d-bd35-457f-8ed7-7e1cbf13bbfb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:18.614213 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a8cea8d-bd35-457f-8ed7-7e1cbf13bbfb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:18.614670 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a8cea8d-bd35-457f-8ed7-7e1cbf13bbfb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:18.616037 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a8cea8d-bd35-457f-8ed7-7e1cbf13bbfb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:18.616850 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a8cea8d-bd35-457f-8ed7-7e1cbf13bbfb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:18.744628 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7594e81b-84d2-4941-afd0-d9c713a281fe tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:18.756558 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7594e81b-84d2-4941-afd0-d9c713a281fe tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1497 microversion: 2.1 time: 0.253224 Jun 02 13:38:18.757367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 127/243] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:18 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:18.840664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a8cea8d-bd35-457f-8ed7-7e1cbf13bbfb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:18.850684 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3a8cea8d-bd35-457f-8ed7-7e1cbf13bbfb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.257798 Jun 02 13:38:18.851725 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 117/244] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:18 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:19.724901 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2baf572e-22d1-4020-bc81-ff5b86273cbc tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:19.725632 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2baf572e-22d1-4020-bc81-ff5b86273cbc tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:19.735399 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2baf572e-22d1-4020-bc81-ff5b86273cbc tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:19.748000 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2baf572e-22d1-4020-bc81-ff5b86273cbc tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:19.748948 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2baf572e-22d1-4020-bc81-ff5b86273cbc tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:19.749402 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2baf572e-22d1-4020-bc81-ff5b86273cbc tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:19.781496 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:19.811249 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2baf572e-22d1-4020-bc81-ff5b86273cbc tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:38:19.877957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2ebeda5d-5509-4e70-81a9-a78e0ec043fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:19.878620 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2ebeda5d-5509-4e70-81a9-a78e0ec043fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:19.913180 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ebeda5d-5509-4e70-81a9-a78e0ec043fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:19.913616 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ebeda5d-5509-4e70-81a9-a78e0ec043fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:19.914552 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ebeda5d-5509-4e70-81a9-a78e0ec043fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:19.915101 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ebeda5d-5509-4e70-81a9-a78e0ec043fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:20.053453 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2baf572e-22d1-4020-bc81-ff5b86273cbc tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 204 len: 0 microversion: 2.1 time: 0.332732 Jun 02 13:38:20.054793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 128/245] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:38:19 2022] DELETE /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:38:20.066572 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-dcd7eed1-c46b-4084-920c-74251d40c270 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:20.067744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-dcd7eed1-c46b-4084-920c-74251d40c270 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:20.076073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dcd7eed1-c46b-4084-920c-74251d40c270 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:20.076923 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dcd7eed1-c46b-4084-920c-74251d40c270 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:20.077935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dcd7eed1-c46b-4084-920c-74251d40c270 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:20.078601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dcd7eed1-c46b-4084-920c-74251d40c270 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:20.298433 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2ebeda5d-5509-4e70-81a9-a78e0ec043fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:20.307158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2ebeda5d-5509-4e70-81a9-a78e0ec043fb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.433135 Jun 02 13:38:20.311523 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 118/246] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:19 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:20.373927 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-dcd7eed1-c46b-4084-920c-74251d40c270 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:20.386884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-dcd7eed1-c46b-4084-920c-74251d40c270 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1503 microversion: 2.1 time: 0.324249 Jun 02 13:38:20.388059 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 129/247] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:20 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:21.323671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cc5958aa-25d8-4e87-b73b-c113434502c6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:21.324361 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cc5958aa-25d8-4e87-b73b-c113434502c6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:21.341941 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc5958aa-25d8-4e87-b73b-c113434502c6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:21.342825 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc5958aa-25d8-4e87-b73b-c113434502c6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:21.343868 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc5958aa-25d8-4e87-b73b-c113434502c6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:21.344617 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc5958aa-25d8-4e87-b73b-c113434502c6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:21.405344 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5611c2fc-9a61-4483-a694-766c7264e870 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:21.406588 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5611c2fc-9a61-4483-a694-766c7264e870 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:21.415835 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5611c2fc-9a61-4483-a694-766c7264e870 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:21.416575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5611c2fc-9a61-4483-a694-766c7264e870 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:21.418483 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5611c2fc-9a61-4483-a694-766c7264e870 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:21.419818 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5611c2fc-9a61-4483-a694-766c7264e870 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:22.052203 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5611c2fc-9a61-4483-a694-766c7264e870 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:22.060242 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5611c2fc-9a61-4483-a694-766c7264e870 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1503 microversion: 2.1 time: 0.659551 Jun 02 13:38:22.077168 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 130/248] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:21 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1503 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:22.125322 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cc5958aa-25d8-4e87-b73b-c113434502c6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:22.143136 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cc5958aa-25d8-4e87-b73b-c113434502c6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.823428 Jun 02 13:38:22.143718 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 119/249] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:21 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:22.649330 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c2c1ac94-c96d-4c93-8c28-7d1981bf9f3b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:22.652440 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c2c1ac94-c96d-4c93-8c28-7d1981bf9f3b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:22.666983 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2c1ac94-c96d-4c93-8c28-7d1981bf9f3b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:22.668056 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2c1ac94-c96d-4c93-8c28-7d1981bf9f3b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:22.669545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2c1ac94-c96d-4c93-8c28-7d1981bf9f3b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:22.671073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2c1ac94-c96d-4c93-8c28-7d1981bf9f3b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:22.716772 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c2c1ac94-c96d-4c93-8c28-7d1981bf9f3b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/ips" status: 200 len: 146 microversion: 2.1 time: 0.073594 Jun 02 13:38:22.717434 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 131/250] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Jun 2 13:38:22 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/ips => generated 146 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:23.083217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8f682e8f-0c93-48db-9c6f-c09cc55785c7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:23.084182 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8f682e8f-0c93-48db-9c6f-c09cc55785c7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:23.094038 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f682e8f-0c93-48db-9c6f-c09cc55785c7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:23.094234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f682e8f-0c93-48db-9c6f-c09cc55785c7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:23.097028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f682e8f-0c93-48db-9c6f-c09cc55785c7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:23.101746 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f682e8f-0c93-48db-9c6f-c09cc55785c7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:23.164524 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7ef23852-4a04-4765-a343-b937d80073f4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:23.165143 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7ef23852-4a04-4765-a343-b937d80073f4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:23.181977 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7ef23852-4a04-4765-a343-b937d80073f4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:23.184899 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7ef23852-4a04-4765-a343-b937d80073f4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:23.185716 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7ef23852-4a04-4765-a343-b937d80073f4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:23.186160 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7ef23852-4a04-4765-a343-b937d80073f4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:23.459874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7ef23852-4a04-4765-a343-b937d80073f4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:23.469165 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7ef23852-4a04-4765-a343-b937d80073f4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.312383 Jun 02 13:38:23.470680 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 132/251] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:23 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:23.498829 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8f682e8f-0c93-48db-9c6f-c09cc55785c7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:23.509498 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8f682e8f-0c93-48db-9c6f-c09cc55785c7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1503 microversion: 2.1 time: 0.430900 Jun 02 13:38:23.511205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 120/252] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:23 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1503 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:23.749620 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-2958a64d-6d7d-4c5f-a23c-3192f0baa0ab req-33783a4e-b725-482f-bc37-7d5f1200a263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3", "name": "network-vif-deleted", "tag": "f41257d2-499c-4ffa-bdcb-68057c448a28"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:23.766063 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-2958a64d-6d7d-4c5f-a23c-3192f0baa0ab req-33783a4e-b725-482f-bc37-7d5f1200a263 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:23.766647 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-2958a64d-6d7d-4c5f-a23c-3192f0baa0ab req-33783a4e-b725-482f-bc37-7d5f1200a263 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:23.783459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-2958a64d-6d7d-4c5f-a23c-3192f0baa0ab req-33783a4e-b725-482f-bc37-7d5f1200a263 service nova] Creating event network-vif-deleted:f41257d2-499c-4ffa-bdcb-68057c448a28 for instance 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 on hv-cinder-83608 Jun 02 13:38:23.797100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-2958a64d-6d7d-4c5f-a23c-3192f0baa0ab req-33783a4e-b725-482f-bc37-7d5f1200a263 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059426 Jun 02 13:38:23.798346 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 133/253] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:24.487154 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c369665f-8ba3-4837-80a9-db522849e045 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:24.489087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c369665f-8ba3-4837-80a9-db522849e045 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:24.502776 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c369665f-8ba3-4837-80a9-db522849e045 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:24.503632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c369665f-8ba3-4837-80a9-db522849e045 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:24.505234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c369665f-8ba3-4837-80a9-db522849e045 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:24.507067 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c369665f-8ba3-4837-80a9-db522849e045 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:24.531029 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:24.532024 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:24.553183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:24.554094 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:24.555258 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:24.555941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:24.613465 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:24.614317 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:24.615050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lazy-loading 'fault' on Instance uuid 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:38:24.685845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:24.698060 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-da8e41cb-89f9-4dc0-8fe6-f8510b3c97be tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 200 len: 1303 microversion: 2.1 time: 0.172328 Jun 02 13:38:24.710018 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 134/254] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:24 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 1303 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:24.794963 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c369665f-8ba3-4837-80a9-db522849e045 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:24.803396 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c369665f-8ba3-4837-80a9-db522849e045 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.320315 Jun 02 13:38:24.808873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 121/255] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:24 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:25.239828 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-72b1d274-fdd8-43f3-bb50-e6f5903faa1a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:25.240418 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-72b1d274-fdd8-43f3-bb50-e6f5903faa1a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:25.251374 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72b1d274-fdd8-43f3-bb50-e6f5903faa1a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:25.251843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72b1d274-fdd8-43f3-bb50-e6f5903faa1a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:25.252694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72b1d274-fdd8-43f3-bb50-e6f5903faa1a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:25.253126 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72b1d274-fdd8-43f3-bb50-e6f5903faa1a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:25.285806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-72b1d274-fdd8-43f3-bb50-e6f5903faa1a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/ips" status: 200 len: 150 microversion: 2.1 time: 0.047998 Jun 02 13:38:25.286426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 135/256] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Jun 2 13:38:25 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/ips => generated 150 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:25.716779 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7035144a-d5be-44df-802d-2e3ed910a229 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:25.717574 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7035144a-d5be-44df-802d-2e3ed910a229 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:25.724899 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7035144a-d5be-44df-802d-2e3ed910a229 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:25.725429 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7035144a-d5be-44df-802d-2e3ed910a229 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:25.726279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7035144a-d5be-44df-802d-2e3ed910a229 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:25.726760 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7035144a-d5be-44df-802d-2e3ed910a229 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:25.753418 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-7035144a-d5be-44df-802d-2e3ed910a229 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] HTTP exception thrown: Instance 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 could not be found. Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7035144a-d5be-44df-802d-2e3ed910a229 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Request method failure captured: Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 HTTP/1.1 Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimL002758t7dCcz2s5KvKeyCu2_wYJWCR9L4TF21HbtEo8kRl3UMCLLe3YIFOzSrVYwVBZ5Zx6mtX_mcWjCIsPsLgsJAurKqvk5VtV04VYy2_mVTpWlq-OszR7k6CTXSSFeqv-v9F3Lbg8sbgMaOZ_erpRP8UX7TA-Op20JbxE6bNyKw Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 46301efc51224c3db7660777fac426b2 Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesActionsTest-1204238887 Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:38:25.762494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/46301efc51224c3db7660777fac426b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_46301efc51224c3db7660777fac426b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/46301efc51224c3db7660777fac426b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/46301efc51224c3db7660777fac426b2"}]}] Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesActionsTest-1204238887 Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 46301efc51224c3db7660777fac426b2 Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesActionsTest-1204238887 Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesActionsTest-1204238887-project Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 2351177553054eeebc4c60abcfecfa70 Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesActionsTest-1204238887-project Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 could not be found. Jun 02 13:38:25.763719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3'} Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 could not be found. Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:38:25.764587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 could not be found. Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 could not be found. Jun 02 13:38:25.765688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:38:25.766661 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7035144a-d5be-44df-802d-2e3ed910a229 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Returning 404 to user: Instance 6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:38:25.766661 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7035144a-d5be-44df-802d-2e3ed910a229 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3" status: 404 len: 111 microversion: 2.1 time: 0.051462 Jun 02 13:38:25.777954 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 122/257] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:25 2022] GET /compute/v2.1/servers/6ca8f3e4-70d1-469f-adf3-73e85bdeb0f3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:38:25.825956 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-dd99f9f7-3d8d-4083-90d3-5d84bccfa760 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:25.826364 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-dd99f9f7-3d8d-4083-90d3-5d84bccfa760 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:25.836830 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd99f9f7-3d8d-4083-90d3-5d84bccfa760 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:25.838187 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd99f9f7-3d8d-4083-90d3-5d84bccfa760 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:25.839905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd99f9f7-3d8d-4083-90d3-5d84bccfa760 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:25.840640 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd99f9f7-3d8d-4083-90d3-5d84bccfa760 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:25.972878 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-53042580", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "networks": [{"uuid": "6dc744f7-ccc0-4556-972f-b3b64d2e2c9e"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:26.065200 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] validate_networks() for [('6dc744f7-ccc0-4556-972f-b3b64d2e2c9e', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:38:26.077276 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-dd99f9f7-3d8d-4083-90d3-5d84bccfa760 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:26.089751 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-dd99f9f7-3d8d-4083-90d3-5d84bccfa760 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.267827 Jun 02 13:38:26.091073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 136/258] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:25 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:27.027543 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0ba2ee04-720a-4981-86e7-a2fbdce1ca33 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cea95873-62fe-4110-aee7-ab5845454f6e"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:27.033450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0ba2ee04-720a-4981-86e7-a2fbdce1ca33 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:27.059219 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ba2ee04-720a-4981-86e7-a2fbdce1ca33 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:27.062175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ba2ee04-720a-4981-86e7-a2fbdce1ca33 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:27.067650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ba2ee04-720a-4981-86e7-a2fbdce1ca33 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:27.068938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ba2ee04-720a-4981-86e7-a2fbdce1ca33 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:27.212955 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:38:27.213493 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:38:27.213847 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:38:27.214569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:38:27.214999 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:38:27.227547 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:27.227992 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:27.228860 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:27.229296 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:27.247459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Getting quotas for project 46301efc51224c3db7660777fac426b2. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:38:27.252523 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Getting quotas for user 2351177553054eeebc4c60abcfecfa70 and project 46301efc51224c3db7660777fac426b2. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:38:27.267077 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:38:27.269524 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:38:27.376132 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c278fe75-c4f4-4425-92a9-cfb71bbdc2d7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409595 Jun 02 13:38:27.377552 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 123/259] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:38:27.382714 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-adeb3366-e0fc-4a11-8883-20538149aaeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:27.383859 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-adeb3366-e0fc-4a11-8883-20538149aaeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:27.391810 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-adeb3366-e0fc-4a11-8883-20538149aaeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:27.392557 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-adeb3366-e0fc-4a11-8883-20538149aaeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:27.393728 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-adeb3366-e0fc-4a11-8883-20538149aaeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:27.394933 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-adeb3366-e0fc-4a11-8883-20538149aaeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:27.653314 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0ba2ee04-720a-4981-86e7-a2fbdce1ca33 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630924 Jun 02 13:38:27.655971 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 137/260] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:38:27 2022] POST /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:27.670771 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-082ff3b9-d62a-45cc-9829-398d8062076d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:27.672024 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-082ff3b9-d62a-45cc-9829-398d8062076d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:28.049126 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-adeb3366-e0fc-4a11-8883-20538149aaeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:28.060021 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-082ff3b9-d62a-45cc-9829-398d8062076d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:28.071339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-082ff3b9-d62a-45cc-9829-398d8062076d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1212 microversion: 2.1 time: 0.409667 Jun 02 13:38:28.084116 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 138/261] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:27 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1212 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:28.089266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-adeb3366-e0fc-4a11-8883-20538149aaeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.705107 Jun 02 13:38:28.090379 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 124/262] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:27 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:28.091781 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4e0e4909-5a3a-4f49-8107-a555b5939d0a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "759e7466-8430-455e-a02d-55bd0656186b"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:28.093283 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4e0e4909-5a3a-4f49-8107-a555b5939d0a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:28.101703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e0e4909-5a3a-4f49-8107-a555b5939d0a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:28.102425 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e0e4909-5a3a-4f49-8107-a555b5939d0a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:28.103517 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e0e4909-5a3a-4f49-8107-a555b5939d0a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:28.104285 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e0e4909-5a3a-4f49-8107-a555b5939d0a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:28.570154 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4e0e4909-5a3a-4f49-8107-a555b5939d0a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484419 Jun 02 13:38:28.573680 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 139/263] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:38:28 2022] POST /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:28.638499 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4ef377e7-57c4-4161-a600-2cbe5625c228 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:28.639125 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4ef377e7-57c4-4161-a600-2cbe5625c228 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:28.660543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ef377e7-57c4-4161-a600-2cbe5625c228 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:28.661649 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ef377e7-57c4-4161-a600-2cbe5625c228 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:28.666737 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ef377e7-57c4-4161-a600-2cbe5625c228 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:28.667276 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ef377e7-57c4-4161-a600-2cbe5625c228 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:28.784864 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4ef377e7-57c4-4161-a600-2cbe5625c228 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/ips" status: 200 len: 152 microversion: 2.20 time: 0.148970 Jun 02 13:38:28.787175 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 125/264] 10.222.0.32 () {60 vars in 1288 bytes} [Thu Jun 2 13:38:28 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/ips => generated 152 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:38:29.098907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f24c3749-1cf8-4c76-b982-596db399157c tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:29.102423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f24c3749-1cf8-4c76-b982-596db399157c tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:29.106948 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5bace2b3-4334-4e6a-82f3-b89201f694ca tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:29.107814 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5bace2b3-4334-4e6a-82f3-b89201f694ca tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:29.115278 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5bace2b3-4334-4e6a-82f3-b89201f694ca tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:29.120049 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5bace2b3-4334-4e6a-82f3-b89201f694ca tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:29.121649 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5bace2b3-4334-4e6a-82f3-b89201f694ca tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:29.122352 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5bace2b3-4334-4e6a-82f3-b89201f694ca tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:29.125654 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f24c3749-1cf8-4c76-b982-596db399157c tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:29.126395 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f24c3749-1cf8-4c76-b982-596db399157c tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:29.133826 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f24c3749-1cf8-4c76-b982-596db399157c tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:29.134443 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f24c3749-1cf8-4c76-b982-596db399157c tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:29.595989 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f24c3749-1cf8-4c76-b982-596db399157c tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:29.605735 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f24c3749-1cf8-4c76-b982-596db399157c tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1264 microversion: 2.1 time: 0.519041 Jun 02 13:38:29.610614 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 140/265] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:29 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1264 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:29.951380 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5bace2b3-4334-4e6a-82f3-b89201f694ca tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:29.966733 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5bace2b3-4334-4e6a-82f3-b89201f694ca tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.860755 Jun 02 13:38:29.976340 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 126/266] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:29 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:30.629821 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-58920070-4362-42e0-9085-6b3f99c8251f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:30.631076 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-58920070-4362-42e0-9085-6b3f99c8251f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:30.640557 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58920070-4362-42e0-9085-6b3f99c8251f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:30.641241 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58920070-4362-42e0-9085-6b3f99c8251f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:30.642028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58920070-4362-42e0-9085-6b3f99c8251f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:30.642634 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58920070-4362-42e0-9085-6b3f99c8251f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:30.808275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-58920070-4362-42e0-9085-6b3f99c8251f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:30.816973 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-58920070-4362-42e0-9085-6b3f99c8251f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1270 microversion: 2.1 time: 0.193403 Jun 02 13:38:30.826352 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 141/267] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:30 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:30.981752 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-875e9b51-ade8-47a9-91b8-6d45422a3862 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:30.983080 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-875e9b51-ade8-47a9-91b8-6d45422a3862 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:30.988518 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fbfcf59d-4c73-405c-88d7-5aebec83fb89 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:30.989137 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fbfcf59d-4c73-405c-88d7-5aebec83fb89 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:30.999645 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-875e9b51-ade8-47a9-91b8-6d45422a3862 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:30.999852 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fbfcf59d-4c73-405c-88d7-5aebec83fb89 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.000569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-875e9b51-ade8-47a9-91b8-6d45422a3862 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.001813 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fbfcf59d-4c73-405c-88d7-5aebec83fb89 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.002103 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-875e9b51-ade8-47a9-91b8-6d45422a3862 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.002912 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-875e9b51-ade8-47a9-91b8-6d45422a3862 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.003386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fbfcf59d-4c73-405c-88d7-5aebec83fb89 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.005220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fbfcf59d-4c73-405c-88d7-5aebec83fb89 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.050386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-875e9b51-ade8-47a9-91b8-6d45422a3862 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lazy-loading 'flavor' on Instance uuid bf15208f-0bda-407c-8ea0-38a1300bfa16 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:38:31.493459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fbfcf59d-4c73-405c-88d7-5aebec83fb89 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:31.496103 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:31.509451 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fbfcf59d-4c73-405c-88d7-5aebec83fb89 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.526926 Jun 02 13:38:31.510999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 142/268] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:30 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:31.652689 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-875e9b51-ade8-47a9-91b8-6d45422a3862 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "POST /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/action" status: 202 len: 0 microversion: 2.20 time: 0.676978 Jun 02 13:38:31.653984 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 127/269] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Jun 2 13:38:30 2022] POST /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/action => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:38:31.663539 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5a33a465-5430-441c-8ae4-652e8b83a8b9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:31.664976 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5a33a465-5430-441c-8ae4-652e8b83a8b9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:31.681449 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a33a465-5430-441c-8ae4-652e8b83a8b9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.682969 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a33a465-5430-441c-8ae4-652e8b83a8b9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.684074 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a33a465-5430-441c-8ae4-652e8b83a8b9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.684772 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a33a465-5430-441c-8ae4-652e8b83a8b9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.835831 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e0819fc4-ea7e-411e-8314-e3a3e44b7bf5 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:31.836639 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e0819fc4-ea7e-411e-8314-e3a3e44b7bf5 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:31.850600 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e0819fc4-ea7e-411e-8314-e3a3e44b7bf5 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.851056 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e0819fc4-ea7e-411e-8314-e3a3e44b7bf5 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:31.851831 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e0819fc4-ea7e-411e-8314-e3a3e44b7bf5 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:31.856104 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e0819fc4-ea7e-411e-8314-e3a3e44b7bf5 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:32.145470 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5a33a465-5430-441c-8ae4-652e8b83a8b9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:32.158041 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5a33a465-5430-441c-8ae4-652e8b83a8b9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:32.160395 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5a33a465-5430-441c-8ae4-652e8b83a8b9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:32.161762 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5a33a465-5430-441c-8ae4-652e8b83a8b9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.503379 Jun 02 13:38:32.168642 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 143/270] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:31 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:32.560506 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d8d8663a-5834-4280-b0fe-35f8bbdce86e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:32.569656 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d8d8663a-5834-4280-b0fe-35f8bbdce86e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:32.589464 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8d8663a-5834-4280-b0fe-35f8bbdce86e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:32.590559 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8d8663a-5834-4280-b0fe-35f8bbdce86e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:32.591735 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8d8663a-5834-4280-b0fe-35f8bbdce86e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:32.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8d8663a-5834-4280-b0fe-35f8bbdce86e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:32.763504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e0819fc4-ea7e-411e-8314-e3a3e44b7bf5 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:32.831315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e0819fc4-ea7e-411e-8314-e3a3e44b7bf5 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.999655 Jun 02 13:38:32.840327 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 128/271] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:31 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:33.182682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bda1cbef-b872-407a-89f8-780418537c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:33.201139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bda1cbef-b872-407a-89f8-780418537c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:33.205152 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda1cbef-b872-407a-89f8-780418537c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:33.205608 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda1cbef-b872-407a-89f8-780418537c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:33.206397 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda1cbef-b872-407a-89f8-780418537c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:33.207418 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda1cbef-b872-407a-89f8-780418537c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:33.530870 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d8d8663a-5834-4280-b0fe-35f8bbdce86e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:33.543475 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d8d8663a-5834-4280-b0fe-35f8bbdce86e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 1.009895 Jun 02 13:38:33.554185 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 144/272] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:32 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:33.627752 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bda1cbef-b872-407a-89f8-780418537c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:33.652659 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bda1cbef-b872-407a-89f8-780418537c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:33.654646 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bda1cbef-b872-407a-89f8-780418537c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:33.656066 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bda1cbef-b872-407a-89f8-780418537c71 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.480525 Jun 02 13:38:33.669171 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 129/273] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:33 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:33.799736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9c7f4a8c-f437-471e-bbb3-682cb630f9e4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Action: 'create', calling method: .version_select at 0x7f8615234040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1904709435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPPbGpvf5ajm8XCHYsX5kgLMMczHeJRjxfdOGMislQvo36rzYhSImu5hACxbr+eHpPdf1KdysQSM0CnzGsPX+jaZ6Iao4Pn1TQ4AgdJm7SHFna3liQhv8Qe2qoRAupjxA=="}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:33.818905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-9c7f4a8c-f437-471e-bbb3-682cb630f9e4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Getting quotas for project 9f83cf655b9d41ebbaf0961d1d2581fc. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:38:33.824057 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-9c7f4a8c-f437-471e-bbb3-682cb630f9e4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Getting quotas for user a41010feed14482d869807c09f365a18 and project 9f83cf655b9d41ebbaf0961d1d2581fc. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:38:33.860428 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-67be5a86-af67-4db0-9cd5-64c8f91205e0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:33.861735 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-67be5a86-af67-4db0-9cd5-64c8f91205e0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:33.868900 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9c7f4a8c-f437-471e-bbb3-682cb630f9e4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.070593 Jun 02 13:38:33.869530 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 145/274] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Jun 2 13:38:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:38:33.881124 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67be5a86-af67-4db0-9cd5-64c8f91205e0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:33.881871 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67be5a86-af67-4db0-9cd5-64c8f91205e0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:33.883487 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67be5a86-af67-4db0-9cd5-64c8f91205e0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:33.884444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67be5a86-af67-4db0-9cd5-64c8f91205e0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:33.998001 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-b91331c0-407f-4c14-9226-51e6697d9e5d req-3562c8c3-528f-4315-be83-ebc329f2a53c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f02e5114-86e5-4424-8292-712d26240714", "tag": "fe8296ca-30ec-4dc0-8351-177e7bb79353"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:34.018818 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-b91331c0-407f-4c14-9226-51e6697d9e5d req-3562c8c3-528f-4315-be83-ebc329f2a53c service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:34.020193 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-b91331c0-407f-4c14-9226-51e6697d9e5d req-3562c8c3-528f-4315-be83-ebc329f2a53c service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:34.040196 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-b91331c0-407f-4c14-9226-51e6697d9e5d req-3562c8c3-528f-4315-be83-ebc329f2a53c service nova] Creating event network-changed:fe8296ca-30ec-4dc0-8351-177e7bb79353 for instance f02e5114-86e5-4424-8292-712d26240714 on hv-cinder-83608 Jun 02 13:38:34.049208 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-b91331c0-407f-4c14-9226-51e6697d9e5d req-3562c8c3-528f-4315-be83-ebc329f2a53c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057461 Jun 02 13:38:34.051486 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 146/275] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:34.075079 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1498907566", "imageRef": "3aed4ea5-004d-4573-bf1e-1b3ca92126b6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1904709435", "networks": [{"uuid": "12dd22f3-110f-46cb-8536-eb44bb7e11c0"}]}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:34.141939 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] validate_networks() for [('12dd22f3-110f-46cb-8536-eb44bb7e11c0', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:38:34.246064 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67be5a86-af67-4db0-9cd5-64c8f91205e0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:34.255156 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-67be5a86-af67-4db0-9cd5-64c8f91205e0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.401852 Jun 02 13:38:34.255725 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 130/276] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:33 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:34.561412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1ac5f35d-4fa4-4cf2-8c4d-1bc3ff84424c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:34.562319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1ac5f35d-4fa4-4cf2-8c4d-1bc3ff84424c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:34.572143 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ac5f35d-4fa4-4cf2-8c4d-1bc3ff84424c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:34.572923 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ac5f35d-4fa4-4cf2-8c4d-1bc3ff84424c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:34.573970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ac5f35d-4fa4-4cf2-8c4d-1bc3ff84424c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:34.574671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ac5f35d-4fa4-4cf2-8c4d-1bc3ff84424c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:34.580691 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:34.807393 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1ac5f35d-4fa4-4cf2-8c4d-1bc3ff84424c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:34.815403 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1ac5f35d-4fa4-4cf2-8c4d-1bc3ff84424c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.258938 Jun 02 13:38:34.816236 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 131/277] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:34 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:34.829012 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dafce9f3-8576-4e75-8dfb-2b06a81a4921 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:34.829903 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dafce9f3-8576-4e75-8dfb-2b06a81a4921 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:34.849861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dafce9f3-8576-4e75-8dfb-2b06a81a4921 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:34.850326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dafce9f3-8576-4e75-8dfb-2b06a81a4921 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:34.851309 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dafce9f3-8576-4e75-8dfb-2b06a81a4921 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:34.851649 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dafce9f3-8576-4e75-8dfb-2b06a81a4921 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:34.862785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:38:34.863257 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:38:34.863834 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:38:34.864246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:38:34.864768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:38:34.878108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:34.880973 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:34.882020 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:34.882894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:34.924652 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Getting quotas for project 9f83cf655b9d41ebbaf0961d1d2581fc. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:38:34.934954 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Getting quotas for user a41010feed14482d869807c09f365a18 and project 9f83cf655b9d41ebbaf0961d1d2581fc. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:38:34.965160 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:38:34.972801 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3aed4ea5-004d-4573-bf1e-1b3ca92126b6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:38:35.034380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9303d27f-b104-4069-bade-83c457a20517 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969792 Jun 02 13:38:35.035189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 147/278] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:38:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:38:35.051022 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ab582caa-4056-4546-9905-bc650fe93853 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:35.051879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ab582caa-4056-4546-9905-bc650fe93853 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:35.054279 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:35.175831 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ab582caa-4056-4546-9905-bc650fe93853 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:35.185682 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ab582caa-4056-4546-9905-bc650fe93853 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1259 microversion: 2.1 time: 0.144405 Jun 02 13:38:35.187509 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 148/279] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:35 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:35.213417 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dafce9f3-8576-4e75-8dfb-2b06a81a4921 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:35.240344 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dafce9f3-8576-4e75-8dfb-2b06a81a4921 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:35.241932 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dafce9f3-8576-4e75-8dfb-2b06a81a4921 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:35.249804 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dafce9f3-8576-4e75-8dfb-2b06a81a4921 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.432498 Jun 02 13:38:35.252841 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 132/280] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:34 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:35.270697 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0a0e5374-e331-4df6-9b8a-22bb114d919f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:35.271318 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0a0e5374-e331-4df6-9b8a-22bb114d919f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:35.282374 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a0e5374-e331-4df6-9b8a-22bb114d919f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:35.282834 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a0e5374-e331-4df6-9b8a-22bb114d919f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:35.284478 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a0e5374-e331-4df6-9b8a-22bb114d919f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:35.285466 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a0e5374-e331-4df6-9b8a-22bb114d919f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:35.748108 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-15c57b51-de94-40fc-a6a4-eb30331d5066 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: .version_select at 0x7f861514f0d0>, body: {"keypair": {"name": "tempest-keypair-890763141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1gJVZKhYGKMZju/7pWFCtGF1dazmZQUfXoAKzJsJFtSEPRz4tFygPOp8oFEIFXd/CftSv1NabxRSDPHoE1iN78KX7xBFD79HC64sRLo2NBSflwa5yxSzvYiAa8qXwBxg=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:35.782381 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0a0e5374-e331-4df6-9b8a-22bb114d919f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:35.792150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0a0e5374-e331-4df6-9b8a-22bb114d919f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.525178 Jun 02 13:38:35.792761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 149/281] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:35 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:35.803896 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-15c57b51-de94-40fc-a6a4-eb30331d5066 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:38:35.812343 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-15c57b51-de94-40fc-a6a4-eb30331d5066 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for user a1622acb057f419ca98e7d44584c276d and project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:38:35.835307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-10a89767-2abc-4f7d-af1e-3b9cb2234ef0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:35.836538 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-10a89767-2abc-4f7d-af1e-3b9cb2234ef0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:35.851348 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-15c57b51-de94-40fc-a6a4-eb30331d5066 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107025 Jun 02 13:38:35.853492 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10a89767-2abc-4f7d-af1e-3b9cb2234ef0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:35.854216 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10a89767-2abc-4f7d-af1e-3b9cb2234ef0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:35.857291 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10a89767-2abc-4f7d-af1e-3b9cb2234ef0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:35.859654 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10a89767-2abc-4f7d-af1e-3b9cb2234ef0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:35.860692 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 133/282] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Jun 2 13:38:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:38:36.107522 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-10a89767-2abc-4f7d-af1e-3b9cb2234ef0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:36.119807 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-10a89767-2abc-4f7d-af1e-3b9cb2234ef0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.290390 Jun 02 13:38:36.121046 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 150/283] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:35 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:36.208410 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-74c91687-6739-496c-bb1c-ff751572dfe0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:36.209187 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-74c91687-6739-496c-bb1c-ff751572dfe0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:36.228137 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74c91687-6739-496c-bb1c-ff751572dfe0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:36.228790 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74c91687-6739-496c-bb1c-ff751572dfe0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:36.229549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74c91687-6739-496c-bb1c-ff751572dfe0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:36.230121 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74c91687-6739-496c-bb1c-ff751572dfe0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:36.270994 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-71f4e183-9c49-423f-a8af-54d3aa965890 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:36.272066 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-71f4e183-9c49-423f-a8af-54d3aa965890 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:36.281979 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-71f4e183-9c49-423f-a8af-54d3aa965890 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:36.282668 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-71f4e183-9c49-423f-a8af-54d3aa965890 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:36.283734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-71f4e183-9c49-423f-a8af-54d3aa965890 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:36.284453 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-71f4e183-9c49-423f-a8af-54d3aa965890 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:36.382673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-74c91687-6739-496c-bb1c-ff751572dfe0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:36.410753 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-74c91687-6739-496c-bb1c-ff751572dfe0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1263 microversion: 2.1 time: 0.207308 Jun 02 13:38:36.412527 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 134/284] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:36 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1263 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:36.810071 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2edf230a-8282-4c1d-abba-07b678cb0cd0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:36.810698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2edf230a-8282-4c1d-abba-07b678cb0cd0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:36.839192 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2edf230a-8282-4c1d-abba-07b678cb0cd0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:36.840036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2edf230a-8282-4c1d-abba-07b678cb0cd0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:36.842490 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2edf230a-8282-4c1d-abba-07b678cb0cd0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:36.844843 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2edf230a-8282-4c1d-abba-07b678cb0cd0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:37.239173 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:37.331965 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-71f4e183-9c49-423f-a8af-54d3aa965890 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:37.345817 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-71f4e183-9c49-423f-a8af-54d3aa965890 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:37.349202 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-71f4e183-9c49-423f-a8af-54d3aa965890 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:37.352325 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-71f4e183-9c49-423f-a8af-54d3aa965890 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 1.086117 Jun 02 13:38:37.363418 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 151/285] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:36 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:38:37.363418 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f2d477ce-22ae-4902-bf47-ffdeccb4f658 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:37.363418 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f2d477ce-22ae-4902-bf47-ffdeccb4f658 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:37.370669 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2d477ce-22ae-4902-bf47-ffdeccb4f658 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:37.371220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2d477ce-22ae-4902-bf47-ffdeccb4f658 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:37.372603 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2d477ce-22ae-4902-bf47-ffdeccb4f658 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:37.373125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2d477ce-22ae-4902-bf47-ffdeccb4f658 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:37.798688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2edf230a-8282-4c1d-abba-07b678cb0cd0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:37.820795 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2edf230a-8282-4c1d-abba-07b678cb0cd0 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 1.015721 Jun 02 13:38:37.836880 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 135/286] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:36 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:37.848180 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7308d41e-0848-418f-925c-c69bae6611ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:37.853748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7308d41e-0848-418f-925c-c69bae6611ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:37.864177 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7308d41e-0848-418f-925c-c69bae6611ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:37.864808 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7308d41e-0848-418f-925c-c69bae6611ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:37.865984 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7308d41e-0848-418f-925c-c69bae6611ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:37.866589 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7308d41e-0848-418f-925c-c69bae6611ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:37.877138 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f2d477ce-22ae-4902-bf47-ffdeccb4f658 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:37.941067 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f2d477ce-22ae-4902-bf47-ffdeccb4f658 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.583338 Jun 02 13:38:37.959887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 152/287] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:37 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:38.003315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7308d41e-0848-418f-925c-c69bae6611ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:38.016968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7308d41e-0848-418f-925c-c69bae6611ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1311 microversion: 2.1 time: 0.178652 Jun 02 13:38:38.038323 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 136/288] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:37 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1311 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:38.373763 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-736a8ab1-7c88-4dce-bb7e-f8136fde0b8c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:38.375665 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-736a8ab1-7c88-4dce-bb7e-f8136fde0b8c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:38.384592 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-736a8ab1-7c88-4dce-bb7e-f8136fde0b8c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:38.385140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-736a8ab1-7c88-4dce-bb7e-f8136fde0b8c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:38.385847 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-736a8ab1-7c88-4dce-bb7e-f8136fde0b8c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:38.386412 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-736a8ab1-7c88-4dce-bb7e-f8136fde0b8c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:38.650541 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-736a8ab1-7c88-4dce-bb7e-f8136fde0b8c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:38.668120 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-736a8ab1-7c88-4dce-bb7e-f8136fde0b8c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:38.672388 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-736a8ab1-7c88-4dce-bb7e-f8136fde0b8c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:38.673629 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-736a8ab1-7c88-4dce-bb7e-f8136fde0b8c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.306444 Jun 02 13:38:38.676693 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 153/289] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:38 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:38.843196 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8fcadcad-27ee-47f8-ac00-de978a7b7489 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:38.848147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8fcadcad-27ee-47f8-ac00-de978a7b7489 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:38.863704 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8fcadcad-27ee-47f8-ac00-de978a7b7489 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:38.867315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8fcadcad-27ee-47f8-ac00-de978a7b7489 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:38.869208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8fcadcad-27ee-47f8-ac00-de978a7b7489 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:38.869663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8fcadcad-27ee-47f8-ac00-de978a7b7489 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:38.962590 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-711a5382-cbea-4c88-a8d6-0f78e62e7b48 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:38.963209 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-711a5382-cbea-4c88-a8d6-0f78e62e7b48 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:38.980043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-711a5382-cbea-4c88-a8d6-0f78e62e7b48 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:38.980640 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-711a5382-cbea-4c88-a8d6-0f78e62e7b48 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:38.986284 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-711a5382-cbea-4c88-a8d6-0f78e62e7b48 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:38.988874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-711a5382-cbea-4c88-a8d6-0f78e62e7b48 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:39.224028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8fcadcad-27ee-47f8-ac00-de978a7b7489 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:39.233162 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8fcadcad-27ee-47f8-ac00-de978a7b7489 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.393951 Jun 02 13:38:39.233744 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 137/290] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:38 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:39.239253 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c1a39cf1-44d6-44d8-9988-794144d086ce tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:39.240345 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c1a39cf1-44d6-44d8-9988-794144d086ce tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:39.246739 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c1a39cf1-44d6-44d8-9988-794144d086ce tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:39.247488 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c1a39cf1-44d6-44d8-9988-794144d086ce tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:39.248383 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c1a39cf1-44d6-44d8-9988-794144d086ce tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:39.248988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c1a39cf1-44d6-44d8-9988-794144d086ce tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:39.293064 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-711a5382-cbea-4c88-a8d6-0f78e62e7b48 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:39.303303 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-711a5382-cbea-4c88-a8d6-0f78e62e7b48 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1501 microversion: 2.1 time: 0.345002 Jun 02 13:38:39.305216 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 154/291] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:38 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:39.319316 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-123359801", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dbc7e40-4f9d-4008-913e-157e6f3d947d"}], "security_groups": [{"name": "tempest-securitygroup--409008931"}], "key_name": "tempest-keypair-890763141", "user_data": "}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:39.359945 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c1a39cf1-44d6-44d8-9988-794144d086ce tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:39.369780 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c1a39cf1-44d6-44d8-9988-794144d086ce tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1319 microversion: 2.1 time: 0.134722 Jun 02 13:38:39.372491 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 138/292] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:39 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1319 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:39.377329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7ef6a1e6-0e7f-42cd-89af-ad9a9f1cfd9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cc6329f-49b8-4a90-ba7c-1fc8e8e06be2"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:39.378846 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7ef6a1e6-0e7f-42cd-89af-ad9a9f1cfd9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:39.386601 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ef6a1e6-0e7f-42cd-89af-ad9a9f1cfd9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:39.387436 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ef6a1e6-0e7f-42cd-89af-ad9a9f1cfd9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:39.388437 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ef6a1e6-0e7f-42cd-89af-ad9a9f1cfd9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:39.389104 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ef6a1e6-0e7f-42cd-89af-ad9a9f1cfd9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:39.414659 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-7ef6a1e6-0e7f-42cd-89af-ad9a9f1cfd9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] HTTP exception thrown: Cannot 'attach_volume' instance c82cda25-d51b-490e-9102-3de1f9b9066b while it is in vm_state rescued Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7ef6a1e6-0e7f-42cd-89af-ad9a9f1cfd9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Request method failure captured: Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: POST /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b/os-volume_attachments HTTP/1.1 Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 74 Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzSOc8zAN0uDeWOclgH-FIpci9Nk5ZltTZPNxM6Pkn07DHpAN-kLw8-tMMyEZ8olBGqS-_Vv3DH24STayy7hBz2mdCS88fQh0x5WYzrT0SJLDNGvis67219B7mMEZOwSIQ5eMGU1j2HAUo9dRY8qVWWRNCbB-LBVVcpQX5WGbiIlnM Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: ff89a4ee01d444d2aee3bdc9199d556f Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:38:39.416398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ff89a4ee01d444d2aee3bdc9199d556f"}]}] Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: ff89a4ee01d444d2aee3bdc9199d556f Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-ServerRescueNegativeTestJSON-632983293-project Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: b92da35ea7c946ea876b13b13ed98258 Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-ServerRescueNegativeTestJSON-632983293-project Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {"volumeAttachment": {"volumeId": "9cc6329f-49b8-4a90-ba7c-1fc8e8e06be2"}} Jun 02 13:38:39.417730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Cannot 'attach_volume' instance c82cda25-d51b-490e-9102-3de1f9b9066b while it is in vm_state rescued Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'server_id': 'c82cda25-d51b-490e-9102-3de1f9b9066b', 'body': {'volumeAttachment': {'volumeId': '9cc6329f-49b8-4a90-ba7c-1fc8e8e06be2'}}} Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c82cda25-d51b-490e-9102-3de1f9b9066b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:38:39.418504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c82cda25-d51b-490e-9102-3de1f9b9066b while it is in vm_state rescued Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:38:39.419625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:38:39.422072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:38:39.422072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:38:39.422072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c82cda25-d51b-490e-9102-3de1f9b9066b while it is in vm_state rescued Jun 02 13:38:39.422072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:38:39.422072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7ef6a1e6-0e7f-42cd-89af-ad9a9f1cfd9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Returning 409 to user: Cannot 'attach_volume' instance c82cda25-d51b-490e-9102-3de1f9b9066b while it is in vm_state rescued {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:38:39.422072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7ef6a1e6-0e7f-42cd-89af-ad9a9f1cfd9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044315 Jun 02 13:38:39.422072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 139/293] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:38:39 2022] POST /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 02 13:38:39.427569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a985c0bd-e07c-44a9-bcc1-41da50118176 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:39.428212 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a985c0bd-e07c-44a9-bcc1-41da50118176 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:39.434485 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a985c0bd-e07c-44a9-bcc1-41da50118176 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:39.435072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a985c0bd-e07c-44a9-bcc1-41da50118176 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:39.435930 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a985c0bd-e07c-44a9-bcc1-41da50118176 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:39.436480 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a985c0bd-e07c-44a9-bcc1-41da50118176 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:39.467518 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] validate_networks() for [('4dbc7e40-4f9d-4008-913e-157e6f3d947d', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:38:39.509835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a985c0bd-e07c-44a9-bcc1-41da50118176 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b/action" status: 202 len: 0 microversion: 2.1 time: 0.085951 Jun 02 13:38:39.510504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 140/294] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:38:39 2022] POST /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:38:39.519318 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0960756c-bbc2-43f9-b9a6-a6daf5449574 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:39.519721 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0960756c-bbc2-43f9-b9a6-a6daf5449574 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:39.526386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0960756c-bbc2-43f9-b9a6-a6daf5449574 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:39.526843 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0960756c-bbc2-43f9-b9a6-a6daf5449574 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:39.527632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0960756c-bbc2-43f9-b9a6-a6daf5449574 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:39.528076 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0960756c-bbc2-43f9-b9a6-a6daf5449574 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:39.806127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0960756c-bbc2-43f9-b9a6-a6daf5449574 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:39.814296 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0960756c-bbc2-43f9-b9a6-a6daf5449574 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.299439 Jun 02 13:38:39.826305 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 141/295] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:39 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:39.832332 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2c0c42ea-05ca-4624-990a-1f5142564d0d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:39.833352 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2c0c42ea-05ca-4624-990a-1f5142564d0d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:39.840545 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c0c42ea-05ca-4624-990a-1f5142564d0d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:39.841326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c0c42ea-05ca-4624-990a-1f5142564d0d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:39.842342 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c0c42ea-05ca-4624-990a-1f5142564d0d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:39.843003 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c0c42ea-05ca-4624-990a-1f5142564d0d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:40.317102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2c0c42ea-05ca-4624-990a-1f5142564d0d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:40.329514 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2c0c42ea-05ca-4624-990a-1f5142564d0d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:40.345009 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2c0c42ea-05ca-4624-990a-1f5142564d0d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:40.353098 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2c0c42ea-05ca-4624-990a-1f5142564d0d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.525379 Jun 02 13:38:40.354013 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 142/296] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:39 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:40.361629 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3fed5a2c-19c3-4410-ba94-12976d6a6126 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:40.362329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3fed5a2c-19c3-4410-ba94-12976d6a6126 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:40.373613 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3fed5a2c-19c3-4410-ba94-12976d6a6126 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:40.374029 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3fed5a2c-19c3-4410-ba94-12976d6a6126 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:40.375327 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3fed5a2c-19c3-4410-ba94-12976d6a6126 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:40.375917 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3fed5a2c-19c3-4410-ba94-12976d6a6126 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:40.586652 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:38:40.587691 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:38:40.588380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:38:40.588950 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:38:40.589542 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:38:40.605077 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:40.605532 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:40.606342 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:40.606782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:40.646227 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:38:40.661582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for user a1622acb057f419ca98e7d44584c276d and project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:38:40.686397 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:38:40.688575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:38:40.794428 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e40104a3-bd56-44cf-8f28-b24638c24da8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.487847 Jun 02 13:38:40.795505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 155/297] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:38:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:38:40.801121 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-41ac25b6-d1ca-44d1-861b-b9354c7129a1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:40.801948 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-41ac25b6-d1ca-44d1-861b-b9354c7129a1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:40.820863 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-41ac25b6-d1ca-44d1-861b-b9354c7129a1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:40.821495 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-41ac25b6-d1ca-44d1-861b-b9354c7129a1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:40.822450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-41ac25b6-d1ca-44d1-861b-b9354c7129a1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:40.823062 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-41ac25b6-d1ca-44d1-861b-b9354c7129a1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:41.209548 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3fed5a2c-19c3-4410-ba94-12976d6a6126 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:41.217612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3fed5a2c-19c3-4410-ba94-12976d6a6126 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.861840 Jun 02 13:38:41.226204 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 143/298] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:40 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:41.230118 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-41ac25b6-d1ca-44d1-861b-b9354c7129a1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:41.231581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9a845cb8-78b5-4911-b1d5-f139f4572169 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:41.233609 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9a845cb8-78b5-4911-b1d5-f139f4572169 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:41.247249 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-41ac25b6-d1ca-44d1-861b-b9354c7129a1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1317 microversion: 2.1 time: 0.450472 Jun 02 13:38:41.251634 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 156/299] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:40 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:41.266313 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0a7bc301-06e8-47ed-9b0d-65e3b75c2a8d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:41.274032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0a7bc301-06e8-47ed-9b0d-65e3b75c2a8d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:41.302232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a7bc301-06e8-47ed-9b0d-65e3b75c2a8d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:41.313081 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a7bc301-06e8-47ed-9b0d-65e3b75c2a8d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:41.314247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a7bc301-06e8-47ed-9b0d-65e3b75c2a8d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:41.314884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a7bc301-06e8-47ed-9b0d-65e3b75c2a8d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:41.338659 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9a845cb8-78b5-4911-b1d5-f139f4572169 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:41.350609 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9a845cb8-78b5-4911-b1d5-f139f4572169 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1240 microversion: 2.1 time: 0.122059 Jun 02 13:38:41.351932 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 144/300] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:41 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1240 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:41.376959 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5caef20e-7c87-40cb-8562-b51c67ba1f9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:41.378967 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5caef20e-7c87-40cb-8562-b51c67ba1f9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:41.406439 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5caef20e-7c87-40cb-8562-b51c67ba1f9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:41.406901 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5caef20e-7c87-40cb-8562-b51c67ba1f9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:41.407697 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5caef20e-7c87-40cb-8562-b51c67ba1f9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:41.408140 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5caef20e-7c87-40cb-8562-b51c67ba1f9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:41.622348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0a7bc301-06e8-47ed-9b0d-65e3b75c2a8d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:41.633118 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0a7bc301-06e8-47ed-9b0d-65e3b75c2a8d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.380137 Jun 02 13:38:41.634709 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 157/301] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:41 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:41.688902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5caef20e-7c87-40cb-8562-b51c67ba1f9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:41.699038 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5caef20e-7c87-40cb-8562-b51c67ba1f9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:41.700988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5caef20e-7c87-40cb-8562-b51c67ba1f9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:41.702814 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5caef20e-7c87-40cb-8562-b51c67ba1f9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.334464 Jun 02 13:38:41.715314 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 145/302] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:41 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:38:42.242262 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-45d1da0d-4599-4f2f-9da4-05ec603393af tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:42.243091 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-45d1da0d-4599-4f2f-9da4-05ec603393af tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:42.251992 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45d1da0d-4599-4f2f-9da4-05ec603393af tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:42.252476 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45d1da0d-4599-4f2f-9da4-05ec603393af tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:42.253309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45d1da0d-4599-4f2f-9da4-05ec603393af tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:42.253781 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45d1da0d-4599-4f2f-9da4-05ec603393af tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:42.270670 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a5442434-466f-4b64-9745-959a6db2811e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:42.271694 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a5442434-466f-4b64-9745-959a6db2811e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:42.281860 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5442434-466f-4b64-9745-959a6db2811e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:42.282606 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5442434-466f-4b64-9745-959a6db2811e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:42.283566 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5442434-466f-4b64-9745-959a6db2811e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:42.284157 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5442434-466f-4b64-9745-959a6db2811e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:42.653860 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a5442434-466f-4b64-9745-959a6db2811e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:42.669313 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a5442434-466f-4b64-9745-959a6db2811e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.403439 Jun 02 13:38:42.669926 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 146/303] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:42 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:42.693823 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-45d1da0d-4599-4f2f-9da4-05ec603393af tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:42.698233 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-924acff7-e5bf-4c9e-a7c6-afb3765d39a9 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:42.698873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-924acff7-e5bf-4c9e-a7c6-afb3765d39a9 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:42.704693 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-45d1da0d-4599-4f2f-9da4-05ec603393af tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.465946 Jun 02 13:38:42.715226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-924acff7-e5bf-4c9e-a7c6-afb3765d39a9 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:42.715686 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-924acff7-e5bf-4c9e-a7c6-afb3765d39a9 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:42.716127 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 158/304] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:42 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:42.721842 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7a18e78c-f01b-4645-b024-f3df1518173d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:42.722712 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7a18e78c-f01b-4645-b024-f3df1518173d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:42.730158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-924acff7-e5bf-4c9e-a7c6-afb3765d39a9 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:42.731000 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7a18e78c-f01b-4645-b024-f3df1518173d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:42.731650 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-924acff7-e5bf-4c9e-a7c6-afb3765d39a9 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:42.732275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7a18e78c-f01b-4645-b024-f3df1518173d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:42.734286 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7a18e78c-f01b-4645-b024-f3df1518173d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:42.736228 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7a18e78c-f01b-4645-b024-f3df1518173d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:42.847849 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-924acff7-e5bf-4c9e-a7c6-afb3765d39a9 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:42.856847 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-924acff7-e5bf-4c9e-a7c6-afb3765d39a9 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1244 microversion: 2.1 time: 0.177745 Jun 02 13:38:42.861061 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 147/305] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:42 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1244 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:42.870362 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7c0f3208-d72a-40c6-9601-5d454bebf076 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:42.874956 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7c0f3208-d72a-40c6-9601-5d454bebf076 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:42.887643 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7c0f3208-d72a-40c6-9601-5d454bebf076 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:42.892389 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7c0f3208-d72a-40c6-9601-5d454bebf076 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:42.899740 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7c0f3208-d72a-40c6-9601-5d454bebf076 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:42.900338 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7c0f3208-d72a-40c6-9601-5d454bebf076 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:43.229359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7a18e78c-f01b-4645-b024-f3df1518173d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:43.240903 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7a18e78c-f01b-4645-b024-f3df1518173d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.523103 Jun 02 13:38:43.246068 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 159/306] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:42 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:43.278093 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7c0f3208-d72a-40c6-9601-5d454bebf076 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:43.288063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7c0f3208-d72a-40c6-9601-5d454bebf076 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:43.294996 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7c0f3208-d72a-40c6-9601-5d454bebf076 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:43.296227 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7c0f3208-d72a-40c6-9601-5d454bebf076 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.433928 Jun 02 13:38:43.301084 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 148/307] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:42 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:43.686763 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-806f352e-1df9-4d9e-a454-90cbb04caa35 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:43.687453 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-806f352e-1df9-4d9e-a454-90cbb04caa35 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:43.689876 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:43.698828 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-806f352e-1df9-4d9e-a454-90cbb04caa35 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:43.700432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-806f352e-1df9-4d9e-a454-90cbb04caa35 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:43.701623 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-806f352e-1df9-4d9e-a454-90cbb04caa35 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:43.702484 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-806f352e-1df9-4d9e-a454-90cbb04caa35 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:43.711211 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:43.779949 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a537bcb6-8986-4406-9d83-d77433c72b3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Action: 'create', calling method: .version_select at 0x7f86150fd700>, body: {"keypair": {"name": "tempest-TestShelveInstance-346117521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkBdOlE9lEoHaiaMocA3STwho/rsiwUkKxWvMQz6VgmrqgslwEBmozRYhN8G0LxlP4J0WnQMwL1Ciwz1YMaJZpYklRK+JWXz/E1iS+om87h7UKyus8ldA0O6DUW0DTohg=="}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:43.805700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-a537bcb6-8986-4406-9d83-d77433c72b3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Getting quotas for project ba31334d858a4e698ac0f8fc2e846895. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:38:43.811587 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-a537bcb6-8986-4406-9d83-d77433c72b3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Getting quotas for user 02eb6e337f9a4bf5992b8668a6f0fa3a and project ba31334d858a4e698ac0f8fc2e846895. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:38:43.847301 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a537bcb6-8986-4406-9d83-d77433c72b3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.264228 Jun 02 13:38:43.853726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 160/308] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Jun 2 13:38:43 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:43.861401 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-aa5ad166-88ca-4b0b-8484-7f6e0554ff11 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:43.862402 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-aa5ad166-88ca-4b0b-8484-7f6e0554ff11 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:43.869711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aa5ad166-88ca-4b0b-8484-7f6e0554ff11 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:43.870268 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aa5ad166-88ca-4b0b-8484-7f6e0554ff11 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:43.884716 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aa5ad166-88ca-4b0b-8484-7f6e0554ff11 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:43.886971 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aa5ad166-88ca-4b0b-8484-7f6e0554ff11 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:43.957472 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-806f352e-1df9-4d9e-a454-90cbb04caa35 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:43.978672 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-806f352e-1df9-4d9e-a454-90cbb04caa35 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.295955 Jun 02 13:38:43.980281 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 149/309] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:43 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:43.986036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-119a9ebf-53dd-475c-be3e-6cd86c8a40ff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:43.986969 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-119a9ebf-53dd-475c-be3e-6cd86c8a40ff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:43.994899 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-119a9ebf-53dd-475c-be3e-6cd86c8a40ff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:43.995807 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-119a9ebf-53dd-475c-be3e-6cd86c8a40ff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:43.996995 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-119a9ebf-53dd-475c-be3e-6cd86c8a40ff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:43.997774 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-119a9ebf-53dd-475c-be3e-6cd86c8a40ff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:44.150210 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-119a9ebf-53dd-475c-be3e-6cd86c8a40ff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:44.168186 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-119a9ebf-53dd-475c-be3e-6cd86c8a40ff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1244 microversion: 2.1 time: 0.185443 Jun 02 13:38:44.168792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 150/310] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:43 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1244 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:44.258154 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e07a3005-2814-480a-85a4-e3ac3a2b8664 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:44.258786 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e07a3005-2814-480a-85a4-e3ac3a2b8664 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:44.267187 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e07a3005-2814-480a-85a4-e3ac3a2b8664 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:44.268930 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e07a3005-2814-480a-85a4-e3ac3a2b8664 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:44.270739 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-aa5ad166-88ca-4b0b-8484-7f6e0554ff11 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:44.270902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e07a3005-2814-480a-85a4-e3ac3a2b8664 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:44.271228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e07a3005-2814-480a-85a4-e3ac3a2b8664 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:44.282944 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-aa5ad166-88ca-4b0b-8484-7f6e0554ff11 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.426545 Jun 02 13:38:44.283841 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 161/311] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:43 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:44.335883 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e470786b-65b9-453a-9190-ad109949f983 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:44.343178 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e470786b-65b9-453a-9190-ad109949f983 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:44.367923 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e470786b-65b9-453a-9190-ad109949f983 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:44.391225 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e470786b-65b9-453a-9190-ad109949f983 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:44.393033 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e470786b-65b9-453a-9190-ad109949f983 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:44.396110 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e470786b-65b9-453a-9190-ad109949f983 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:44.727470 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e470786b-65b9-453a-9190-ad109949f983 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:44.744455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e470786b-65b9-453a-9190-ad109949f983 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:44.747706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e470786b-65b9-453a-9190-ad109949f983 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:44.749268 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e470786b-65b9-453a-9190-ad109949f983 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.432732 Jun 02 13:38:44.763565 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 162/312] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:44 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:44.766060 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e07a3005-2814-480a-85a4-e3ac3a2b8664 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:44.775320 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e07a3005-2814-480a-85a4-e3ac3a2b8664 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.521281 Jun 02 13:38:44.782947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 151/313] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:44 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:44.997473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a28d31ea-9cbc-4d60-bd1e-60e9d75c9986 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:44.999209 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a28d31ea-9cbc-4d60-bd1e-60e9d75c9986 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:45.033476 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a28d31ea-9cbc-4d60-bd1e-60e9d75c9986 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:45.034835 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a28d31ea-9cbc-4d60-bd1e-60e9d75c9986 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:45.036043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a28d31ea-9cbc-4d60-bd1e-60e9d75c9986 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:45.036649 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a28d31ea-9cbc-4d60-bd1e-60e9d75c9986 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:45.189679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a9ca749b-66de-4370-a494-53ff2136a921 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:45.192653 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a9ca749b-66de-4370-a494-53ff2136a921 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:45.212929 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9ca749b-66de-4370-a494-53ff2136a921 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:45.215805 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9ca749b-66de-4370-a494-53ff2136a921 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:45.217480 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9ca749b-66de-4370-a494-53ff2136a921 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:45.218136 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9ca749b-66de-4370-a494-53ff2136a921 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:45.260432 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a28d31ea-9cbc-4d60-bd1e-60e9d75c9986 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:45.270716 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a28d31ea-9cbc-4d60-bd1e-60e9d75c9986 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.277139 Jun 02 13:38:45.281377 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 163/314] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:44 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:45.302083 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3dafd5f2-0cd7-49fb-a3ed-ae0379755b6f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:45.302894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3dafd5f2-0cd7-49fb-a3ed-ae0379755b6f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:45.316349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3dafd5f2-0cd7-49fb-a3ed-ae0379755b6f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:45.319027 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3dafd5f2-0cd7-49fb-a3ed-ae0379755b6f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:45.322237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3dafd5f2-0cd7-49fb-a3ed-ae0379755b6f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:45.322805 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3dafd5f2-0cd7-49fb-a3ed-ae0379755b6f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:45.324563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a9ca749b-66de-4370-a494-53ff2136a921 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:45.340448 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a9ca749b-66de-4370-a494-53ff2136a921 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1244 microversion: 2.1 time: 0.156267 Jun 02 13:38:45.341607 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 152/315] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:45 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1244 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:45.356867 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:45.652976 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3dafd5f2-0cd7-49fb-a3ed-ae0379755b6f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:45.663452 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3dafd5f2-0cd7-49fb-a3ed-ae0379755b6f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.366420 Jun 02 13:38:45.664669 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 164/316] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:45 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:45.772834 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3851ab2e-3472-4c92-8951-3fa3061659bd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:45.774227 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3851ab2e-3472-4c92-8951-3fa3061659bd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:45.783857 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3851ab2e-3472-4c92-8951-3fa3061659bd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:45.793030 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d80a5cfe-ce28-47e5-a1bb-bc3bc8820836 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:45.793311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3851ab2e-3472-4c92-8951-3fa3061659bd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:45.794052 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d80a5cfe-ce28-47e5-a1bb-bc3bc8820836 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:45.794699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3851ab2e-3472-4c92-8951-3fa3061659bd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:45.795159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3851ab2e-3472-4c92-8951-3fa3061659bd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:45.803225 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d80a5cfe-ce28-47e5-a1bb-bc3bc8820836 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:45.804048 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d80a5cfe-ce28-47e5-a1bb-bc3bc8820836 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:45.805104 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d80a5cfe-ce28-47e5-a1bb-bc3bc8820836 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:45.805769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d80a5cfe-ce28-47e5-a1bb-bc3bc8820836 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:46.168158 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d80a5cfe-ce28-47e5-a1bb-bc3bc8820836 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:46.182225 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d80a5cfe-ce28-47e5-a1bb-bc3bc8820836 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.393898 Jun 02 13:38:46.186962 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 165/317] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:45 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:46.292756 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b0b069ae-41ad-440b-a985-5caff81b0c2c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:46.293650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b0b069ae-41ad-440b-a985-5caff81b0c2c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:46.310194 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b0b069ae-41ad-440b-a985-5caff81b0c2c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:46.311056 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b0b069ae-41ad-440b-a985-5caff81b0c2c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:46.317884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b0b069ae-41ad-440b-a985-5caff81b0c2c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:46.319066 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b0b069ae-41ad-440b-a985-5caff81b0c2c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:46.337021 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3851ab2e-3472-4c92-8951-3fa3061659bd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:46.358152 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3851ab2e-3472-4c92-8951-3fa3061659bd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:46.367843 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3851ab2e-3472-4c92-8951-3fa3061659bd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:46.369377 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3851ab2e-3472-4c92-8951-3fa3061659bd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.602150 Jun 02 13:38:46.390807 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 153/318] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:45 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:46.397676 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ae058d99-3d79-40f9-a874-761cd4bf809e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:46.398560 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ae058d99-3d79-40f9-a874-761cd4bf809e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:46.406357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ae058d99-3d79-40f9-a874-761cd4bf809e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:46.407212 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ae058d99-3d79-40f9-a874-761cd4bf809e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:46.411389 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ae058d99-3d79-40f9-a874-761cd4bf809e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:46.412049 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ae058d99-3d79-40f9-a874-761cd4bf809e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:46.647533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ae058d99-3d79-40f9-a874-761cd4bf809e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:46.656944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ae058d99-3d79-40f9-a874-761cd4bf809e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1244 microversion: 2.1 time: 0.264253 Jun 02 13:38:46.660569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 154/319] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:46 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1244 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:46.681828 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-79b66f92-1a72-4980-aa11-73ec627e783b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:46.682493 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-79b66f92-1a72-4980-aa11-73ec627e783b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:46.697589 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79b66f92-1a72-4980-aa11-73ec627e783b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:46.700189 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79b66f92-1a72-4980-aa11-73ec627e783b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:46.701401 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79b66f92-1a72-4980-aa11-73ec627e783b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:46.703274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79b66f92-1a72-4980-aa11-73ec627e783b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:46.742855 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b0b069ae-41ad-440b-a985-5caff81b0c2c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:46.751640 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b0b069ae-41ad-440b-a985-5caff81b0c2c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.467084 Jun 02 13:38:46.762724 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 166/320] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:46 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:47.009786 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-79b66f92-1a72-4980-aa11-73ec627e783b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:47.021173 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-79b66f92-1a72-4980-aa11-73ec627e783b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.342355 Jun 02 13:38:47.023784 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 155/321] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:46 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:47.198932 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-aed60b97-1228-406e-9449-d6f7c79410df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:47.199552 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-aed60b97-1228-406e-9449-d6f7c79410df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:47.211904 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aed60b97-1228-406e-9449-d6f7c79410df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:47.212602 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aed60b97-1228-406e-9449-d6f7c79410df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:47.213756 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aed60b97-1228-406e-9449-d6f7c79410df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:47.214202 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aed60b97-1228-406e-9449-d6f7c79410df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:47.389553 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-588ba5c1-30a4-4b5d-b689-1f4d7536ccd4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:47.390433 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-588ba5c1-30a4-4b5d-b689-1f4d7536ccd4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:47.403347 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-588ba5c1-30a4-4b5d-b689-1f4d7536ccd4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:47.404193 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-588ba5c1-30a4-4b5d-b689-1f4d7536ccd4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:47.405168 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-588ba5c1-30a4-4b5d-b689-1f4d7536ccd4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:47.408113 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-588ba5c1-30a4-4b5d-b689-1f4d7536ccd4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:47.481785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-aed60b97-1228-406e-9449-d6f7c79410df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:47.500592 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-aed60b97-1228-406e-9449-d6f7c79410df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.301764 Jun 02 13:38:47.500592 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 167/322] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:47 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:47.679206 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3e555d50-74d8-4c39-9fa4-b075becb0ffd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:47.680142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3e555d50-74d8-4c39-9fa4-b075becb0ffd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:47.691364 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3e555d50-74d8-4c39-9fa4-b075becb0ffd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:47.691824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3e555d50-74d8-4c39-9fa4-b075becb0ffd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:47.692645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3e555d50-74d8-4c39-9fa4-b075becb0ffd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:47.693276 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3e555d50-74d8-4c39-9fa4-b075becb0ffd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:47.735456 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-588ba5c1-30a4-4b5d-b689-1f4d7536ccd4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:47.744858 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-588ba5c1-30a4-4b5d-b689-1f4d7536ccd4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:47.746386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-588ba5c1-30a4-4b5d-b689-1f4d7536ccd4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:47.747559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-588ba5c1-30a4-4b5d-b689-1f4d7536ccd4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.361902 Jun 02 13:38:47.752454 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 156/323] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:47 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:38:47.780936 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3e555d50-74d8-4c39-9fa4-b075becb0ffd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:47.781181 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b1df3cb7-d42e-445d-8f00-07361a9a17cb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:47.781993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b1df3cb7-d42e-445d-8f00-07361a9a17cb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:47.789021 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1df3cb7-d42e-445d-8f00-07361a9a17cb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:47.789575 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3e555d50-74d8-4c39-9fa4-b075becb0ffd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1244 microversion: 2.1 time: 0.116096 Jun 02 13:38:47.789698 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1df3cb7-d42e-445d-8f00-07361a9a17cb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:47.790407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1df3cb7-d42e-445d-8f00-07361a9a17cb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:47.790536 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 168/324] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:47 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1244 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:47.791135 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1df3cb7-d42e-445d-8f00-07361a9a17cb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:47.952950 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b1df3cb7-d42e-445d-8f00-07361a9a17cb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:47.961395 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b1df3cb7-d42e-445d-8f00-07361a9a17cb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.184216 Jun 02 13:38:47.961972 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 157/325] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:47 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:48.038740 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cbffe522-2fd6-4813-9f31-aa388cf9611d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:48.039713 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cbffe522-2fd6-4813-9f31-aa388cf9611d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:48.046297 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbffe522-2fd6-4813-9f31-aa388cf9611d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:48.046749 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbffe522-2fd6-4813-9f31-aa388cf9611d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:48.047532 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbffe522-2fd6-4813-9f31-aa388cf9611d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:48.047969 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbffe522-2fd6-4813-9f31-aa388cf9611d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:48.224186 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cbffe522-2fd6-4813-9f31-aa388cf9611d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:48.234389 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cbffe522-2fd6-4813-9f31-aa388cf9611d tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.199922 Jun 02 13:38:48.235159 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 169/326] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:48 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:48.530140 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a0d51bff-cd76-49fc-8492-ce0de470cbff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:48.530828 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a0d51bff-cd76-49fc-8492-ce0de470cbff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:48.545557 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a0d51bff-cd76-49fc-8492-ce0de470cbff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:48.546107 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a0d51bff-cd76-49fc-8492-ce0de470cbff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:48.547236 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a0d51bff-cd76-49fc-8492-ce0de470cbff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:48.547765 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a0d51bff-cd76-49fc-8492-ce0de470cbff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:48.765917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6f0dd5be-3772-424e-aa05-c5b22250455b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:48.766601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6f0dd5be-3772-424e-aa05-c5b22250455b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:48.780358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f0dd5be-3772-424e-aa05-c5b22250455b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:48.780815 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f0dd5be-3772-424e-aa05-c5b22250455b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:48.781596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f0dd5be-3772-424e-aa05-c5b22250455b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:48.782038 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f0dd5be-3772-424e-aa05-c5b22250455b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:48.886633 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a0d51bff-cd76-49fc-8492-ce0de470cbff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:48.901985 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a0d51bff-cd76-49fc-8492-ce0de470cbff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.391217 Jun 02 13:38:48.902577 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 158/327] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:48 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:48.907234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e7ac713f-2397-4a82-8e9e-343a68cc0749 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:48.907843 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e7ac713f-2397-4a82-8e9e-343a68cc0749 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:48.947429 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ac713f-2397-4a82-8e9e-343a68cc0749 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:48.957818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ac713f-2397-4a82-8e9e-343a68cc0749 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:48.959052 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ac713f-2397-4a82-8e9e-343a68cc0749 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:48.960939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ac713f-2397-4a82-8e9e-343a68cc0749 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:49.148399 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e7ac713f-2397-4a82-8e9e-343a68cc0749 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:49.160765 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e7ac713f-2397-4a82-8e9e-343a68cc0749 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1244 microversion: 2.1 time: 0.255785 Jun 02 13:38:49.161877 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 159/328] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:48 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1244 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:49.177383 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ad864caf-620f-4c49-b85f-93dc5c6e7388 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:49.178055 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ad864caf-620f-4c49-b85f-93dc5c6e7388 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:49.192964 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad864caf-620f-4c49-b85f-93dc5c6e7388 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:49.193423 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad864caf-620f-4c49-b85f-93dc5c6e7388 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:49.194217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad864caf-620f-4c49-b85f-93dc5c6e7388 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:49.194656 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad864caf-620f-4c49-b85f-93dc5c6e7388 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:49.235818 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6f0dd5be-3772-424e-aa05-c5b22250455b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:49.251976 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6f0dd5be-3772-424e-aa05-c5b22250455b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:49.255220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6f0dd5be-3772-424e-aa05-c5b22250455b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:49.256659 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6f0dd5be-3772-424e-aa05-c5b22250455b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.494635 Jun 02 13:38:49.257798 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 170/329] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:48 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:38:49.262801 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-0bfd7510-13f4-4d6c-be82-f8f44b2ab106 req-ff3a6674-77a3-484a-962e-2af88f4c24d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02e5114-86e5-4424-8292-712d26240714", "name": "network-vif-plugged", "status": "completed", "tag": "fe8296ca-30ec-4dc0-8351-177e7bb79353"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:49.271925 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-0bfd7510-13f4-4d6c-be82-f8f44b2ab106 req-ff3a6674-77a3-484a-962e-2af88f4c24d1 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:49.272924 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-0bfd7510-13f4-4d6c-be82-f8f44b2ab106 req-ff3a6674-77a3-484a-962e-2af88f4c24d1 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:49.286809 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-0bfd7510-13f4-4d6c-be82-f8f44b2ab106 req-ff3a6674-77a3-484a-962e-2af88f4c24d1 service nova] Creating event network-vif-plugged:fe8296ca-30ec-4dc0-8351-177e7bb79353 for instance f02e5114-86e5-4424-8292-712d26240714 on hv-cinder-83608 Jun 02 13:38:49.292820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-0bfd7510-13f4-4d6c-be82-f8f44b2ab106 req-ff3a6674-77a3-484a-962e-2af88f4c24d1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033567 Jun 02 13:38:49.297023 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 171/330] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:49.306163 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-821d696f-7858-4192-8525-7136fa4be725 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:49.319660 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-821d696f-7858-4192-8525-7136fa4be725 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:49.328774 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-821d696f-7858-4192-8525-7136fa4be725 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:49.329766 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-821d696f-7858-4192-8525-7136fa4be725 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:49.330725 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-821d696f-7858-4192-8525-7136fa4be725 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:49.331349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-821d696f-7858-4192-8525-7136fa4be725 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:49.469809 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ad864caf-620f-4c49-b85f-93dc5c6e7388 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:49.487915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ad864caf-620f-4c49-b85f-93dc5c6e7388 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.323884 Jun 02 13:38:49.488699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 160/331] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:49 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:49.543475 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-821d696f-7858-4192-8525-7136fa4be725 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:49.554724 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-821d696f-7858-4192-8525-7136fa4be725 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.256037 Jun 02 13:38:49.564749 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 172/332] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:49 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:49.925759 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cd35f850-43e6-4fc0-8677-5afb191c410a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:49.926594 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cd35f850-43e6-4fc0-8677-5afb191c410a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:49.933573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd35f850-43e6-4fc0-8677-5afb191c410a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:49.934396 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd35f850-43e6-4fc0-8677-5afb191c410a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:49.935407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd35f850-43e6-4fc0-8677-5afb191c410a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:49.936074 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd35f850-43e6-4fc0-8677-5afb191c410a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:50.078865 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cd35f850-43e6-4fc0-8677-5afb191c410a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:50.091469 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cd35f850-43e6-4fc0-8677-5afb191c410a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.170445 Jun 02 13:38:50.097279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 161/333] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:49 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:50.178558 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-11776241-e9d2-49c6-b3ec-682192ce560a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:50.179217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-11776241-e9d2-49c6-b3ec-682192ce560a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:50.185800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-11776241-e9d2-49c6-b3ec-682192ce560a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:50.186241 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-11776241-e9d2-49c6-b3ec-682192ce560a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:50.187008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-11776241-e9d2-49c6-b3ec-682192ce560a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:50.187445 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-11776241-e9d2-49c6-b3ec-682192ce560a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:50.260863 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-11776241-e9d2-49c6-b3ec-682192ce560a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:50.269401 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-11776241-e9d2-49c6-b3ec-682192ce560a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1244 microversion: 2.1 time: 0.094225 Jun 02 13:38:50.272510 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 173/334] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:50 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1244 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:50.277264 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-10b5a54b-7db8-4a10-917a-40c65206b6e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:50.278155 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-10b5a54b-7db8-4a10-917a-40c65206b6e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:50.284357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10b5a54b-7db8-4a10-917a-40c65206b6e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:50.284818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10b5a54b-7db8-4a10-917a-40c65206b6e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:50.285597 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10b5a54b-7db8-4a10-917a-40c65206b6e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:50.286040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10b5a54b-7db8-4a10-917a-40c65206b6e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:50.426203 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-10b5a54b-7db8-4a10-917a-40c65206b6e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:50.435321 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-10b5a54b-7db8-4a10-917a-40c65206b6e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:50.437297 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-10b5a54b-7db8-4a10-917a-40c65206b6e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:50.438647 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-10b5a54b-7db8-4a10-917a-40c65206b6e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.166890 Jun 02 13:38:50.439858 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 162/335] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:50 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:38:50.508055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-61da870e-d87a-4d26-8943-a5d53b0a6f31 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:50.509000 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-61da870e-d87a-4d26-8943-a5d53b0a6f31 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:50.515467 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61da870e-d87a-4d26-8943-a5d53b0a6f31 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:50.515915 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61da870e-d87a-4d26-8943-a5d53b0a6f31 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:50.517265 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61da870e-d87a-4d26-8943-a5d53b0a6f31 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:50.517695 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61da870e-d87a-4d26-8943-a5d53b0a6f31 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:50.572596 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c617288b-adbd-4d86-8b35-7fb700b4c817 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:50.573226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c617288b-adbd-4d86-8b35-7fb700b4c817 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:50.579595 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c617288b-adbd-4d86-8b35-7fb700b4c817 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:50.580028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c617288b-adbd-4d86-8b35-7fb700b4c817 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:50.581362 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c617288b-adbd-4d86-8b35-7fb700b4c817 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:50.581810 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c617288b-adbd-4d86-8b35-7fb700b4c817 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:50.631261 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:50.706419 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-61da870e-d87a-4d26-8943-a5d53b0a6f31 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:50.714812 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-61da870e-d87a-4d26-8943-a5d53b0a6f31 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.212088 Jun 02 13:38:50.715386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 174/336] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:50 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:50.755266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c617288b-adbd-4d86-8b35-7fb700b4c817 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:50.767942 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c617288b-adbd-4d86-8b35-7fb700b4c817 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.199069 Jun 02 13:38:50.769490 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 163/337] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:50 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:51.108875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3854eb8d-731d-4554-8655-489b0bca2cf3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:51.109563 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3854eb8d-731d-4554-8655-489b0bca2cf3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:51.116487 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3854eb8d-731d-4554-8655-489b0bca2cf3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:51.116937 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3854eb8d-731d-4554-8655-489b0bca2cf3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:51.117700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3854eb8d-731d-4554-8655-489b0bca2cf3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:51.118132 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3854eb8d-731d-4554-8655-489b0bca2cf3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:51.263806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3854eb8d-731d-4554-8655-489b0bca2cf3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:51.272693 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3854eb8d-731d-4554-8655-489b0bca2cf3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.167587 Jun 02 13:38:51.273370 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 175/338] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:51 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:51.286760 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e1d2cef6-7020-4afd-a383-d8cd746b736f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:51.287481 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e1d2cef6-7020-4afd-a383-d8cd746b736f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:51.294359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1d2cef6-7020-4afd-a383-d8cd746b736f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:51.294817 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1d2cef6-7020-4afd-a383-d8cd746b736f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:51.295598 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1d2cef6-7020-4afd-a383-d8cd746b736f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:51.296037 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1d2cef6-7020-4afd-a383-d8cd746b736f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:51.345045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=12 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:51.363934 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e1d2cef6-7020-4afd-a383-d8cd746b736f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:51.371925 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e1d2cef6-7020-4afd-a383-d8cd746b736f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1244 microversion: 2.1 time: 0.089162 Jun 02 13:38:51.372626 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 164/339] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:51 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:51.463828 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-685014bb-e80b-44c4-97a6-4e1e9d8909cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:51.464637 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-685014bb-e80b-44c4-97a6-4e1e9d8909cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:51.473773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-685014bb-e80b-44c4-97a6-4e1e9d8909cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:51.478378 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-685014bb-e80b-44c4-97a6-4e1e9d8909cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:51.479433 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-685014bb-e80b-44c4-97a6-4e1e9d8909cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:51.480012 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-685014bb-e80b-44c4-97a6-4e1e9d8909cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:51.620942 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-685014bb-e80b-44c4-97a6-4e1e9d8909cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:51.629539 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-685014bb-e80b-44c4-97a6-4e1e9d8909cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:51.631040 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-685014bb-e80b-44c4-97a6-4e1e9d8909cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:51.632183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-685014bb-e80b-44c4-97a6-4e1e9d8909cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.173283 Jun 02 13:38:51.632779 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 176/340] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:51 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:51.731743 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d06f6440-2581-4114-b2cc-771dc4199dee tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:51.732395 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d06f6440-2581-4114-b2cc-771dc4199dee tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:51.738752 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d06f6440-2581-4114-b2cc-771dc4199dee tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:51.739267 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d06f6440-2581-4114-b2cc-771dc4199dee tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:51.740149 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d06f6440-2581-4114-b2cc-771dc4199dee tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:51.740710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d06f6440-2581-4114-b2cc-771dc4199dee tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:51.787355 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d1238655-2cce-4157-92bb-1d482197b4ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:51.787984 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d1238655-2cce-4157-92bb-1d482197b4ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:51.794821 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1238655-2cce-4157-92bb-1d482197b4ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:51.795278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1238655-2cce-4157-92bb-1d482197b4ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:51.796055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1238655-2cce-4157-92bb-1d482197b4ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:51.796520 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1238655-2cce-4157-92bb-1d482197b4ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:51.954415 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d06f6440-2581-4114-b2cc-771dc4199dee tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:51.954415 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:51.956584 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d06f6440-2581-4114-b2cc-771dc4199dee tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.227304 Jun 02 13:38:51.956584 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 165/341] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:51 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:51.991023 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d1238655-2cce-4157-92bb-1d482197b4ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:51.998474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d1238655-2cce-4157-92bb-1d482197b4ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.216642 Jun 02 13:38:51.999038 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 177/342] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:51 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:52.290294 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e2b3b33a-758b-49a7-8347-87a88e6efeae tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:52.290958 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e2b3b33a-758b-49a7-8347-87a88e6efeae tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:52.297340 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2b3b33a-758b-49a7-8347-87a88e6efeae tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:52.297820 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2b3b33a-758b-49a7-8347-87a88e6efeae tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:52.298679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2b3b33a-758b-49a7-8347-87a88e6efeae tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:52.299066 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2b3b33a-758b-49a7-8347-87a88e6efeae tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:52.390731 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1ac59fa4-ea64-4cfd-a419-37b93b62bd4f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:52.393149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1ac59fa4-ea64-4cfd-a419-37b93b62bd4f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:52.400696 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1ac59fa4-ea64-4cfd-a419-37b93b62bd4f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:52.401159 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1ac59fa4-ea64-4cfd-a419-37b93b62bd4f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:52.402017 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1ac59fa4-ea64-4cfd-a419-37b93b62bd4f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:52.402598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1ac59fa4-ea64-4cfd-a419-37b93b62bd4f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:52.468613 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e2b3b33a-758b-49a7-8347-87a88e6efeae tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:52.476473 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e2b3b33a-758b-49a7-8347-87a88e6efeae tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.189919 Jun 02 13:38:52.483294 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 166/343] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:52 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:52.489354 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1ac59fa4-ea64-4cfd-a419-37b93b62bd4f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:52.498384 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1ac59fa4-ea64-4cfd-a419-37b93b62bd4f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1244 microversion: 2.1 time: 0.112074 Jun 02 13:38:52.500653 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 178/344] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:52 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1244 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:52.651940 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1240807e-58bc-4ccc-825b-eecb4f45a52e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:52.652510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1240807e-58bc-4ccc-825b-eecb4f45a52e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:52.658502 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1240807e-58bc-4ccc-825b-eecb4f45a52e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:52.658953 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1240807e-58bc-4ccc-825b-eecb4f45a52e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:52.659714 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1240807e-58bc-4ccc-825b-eecb4f45a52e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:52.660150 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1240807e-58bc-4ccc-825b-eecb4f45a52e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:52.794644 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1240807e-58bc-4ccc-825b-eecb4f45a52e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:52.803139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1240807e-58bc-4ccc-825b-eecb4f45a52e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:52.804686 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1240807e-58bc-4ccc-825b-eecb4f45a52e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:52.805937 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1240807e-58bc-4ccc-825b-eecb4f45a52e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.158335 Jun 02 13:38:52.806507 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 167/345] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:52 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:52.972698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8ae0a608-5fcf-4db9-8dc0-781a628b299c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:52.973304 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8ae0a608-5fcf-4db9-8dc0-781a628b299c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:52.979320 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8ae0a608-5fcf-4db9-8dc0-781a628b299c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:52.979766 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8ae0a608-5fcf-4db9-8dc0-781a628b299c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:52.980571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8ae0a608-5fcf-4db9-8dc0-781a628b299c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:52.998113 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8ae0a608-5fcf-4db9-8dc0-781a628b299c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:53.015039 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aaa173b2-d890-48b9-be64-196259665fc7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:53.015675 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aaa173b2-d890-48b9-be64-196259665fc7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:53.023072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aaa173b2-d890-48b9-be64-196259665fc7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:53.023536 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aaa173b2-d890-48b9-be64-196259665fc7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:53.024854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aaa173b2-d890-48b9-be64-196259665fc7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:53.025571 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aaa173b2-d890-48b9-be64-196259665fc7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:53.298098 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8ae0a608-5fcf-4db9-8dc0-781a628b299c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:53.310565 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8ae0a608-5fcf-4db9-8dc0-781a628b299c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.341511 Jun 02 13:38:53.316276 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 179/346] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:52 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:53.329542 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-aaa173b2-d890-48b9-be64-196259665fc7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:53.338711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-aaa173b2-d890-48b9-be64-196259665fc7 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.327257 Jun 02 13:38:53.339142 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 168/347] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:53 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:53.504716 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3a814978-e275-4761-b3c5-abe56c9008cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:53.505389 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3a814978-e275-4761-b3c5-abe56c9008cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:53.514213 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3a814978-e275-4761-b3c5-abe56c9008cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:53.519347 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3a814978-e275-4761-b3c5-abe56c9008cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:53.520241 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3a814978-e275-4761-b3c5-abe56c9008cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:53.520728 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3a814978-e275-4761-b3c5-abe56c9008cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:53.521263 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b26098e3-400e-4370-a1ac-aa6cedc8093e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:53.522300 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b26098e3-400e-4370-a1ac-aa6cedc8093e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:53.539599 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b26098e3-400e-4370-a1ac-aa6cedc8093e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:53.540614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b26098e3-400e-4370-a1ac-aa6cedc8093e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:53.541441 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b26098e3-400e-4370-a1ac-aa6cedc8093e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:53.541950 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b26098e3-400e-4370-a1ac-aa6cedc8093e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:53.677719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b26098e3-400e-4370-a1ac-aa6cedc8093e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:53.689710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b26098e3-400e-4370-a1ac-aa6cedc8093e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1236 microversion: 2.1 time: 0.175222 Jun 02 13:38:53.693343 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 169/348] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:53 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1236 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:53.765120 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3a814978-e275-4761-b3c5-abe56c9008cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:53.776291 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3a814978-e275-4761-b3c5-abe56c9008cb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.287177 Jun 02 13:38:53.777769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 180/349] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:53 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:53.825152 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-353c9f22-0245-4c28-ae36-f858305f022d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:53.825768 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-353c9f22-0245-4c28-ae36-f858305f022d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:53.839769 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-353c9f22-0245-4c28-ae36-f858305f022d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:53.840209 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-353c9f22-0245-4c28-ae36-f858305f022d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:53.841224 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-353c9f22-0245-4c28-ae36-f858305f022d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:53.841819 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-353c9f22-0245-4c28-ae36-f858305f022d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:53.935847 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-28d38694-cbb0-412f-bc78-a6f6a283ed95 req-e4732976-d51d-435d-b28b-4380481994b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2071a11-86aa-4a7f-962c-709f94eb7d6b", "tag": "46bae571-c4cf-494a-ae5d-a0def33d7330"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:53.960973 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=24 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:53.965738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-28d38694-cbb0-412f-bc78-a6f6a283ed95 req-e4732976-d51d-435d-b28b-4380481994b5 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:53.970150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-28d38694-cbb0-412f-bc78-a6f6a283ed95 req-e4732976-d51d-435d-b28b-4380481994b5 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:53.998856 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-28d38694-cbb0-412f-bc78-a6f6a283ed95 req-e4732976-d51d-435d-b28b-4380481994b5 service nova] Creating event network-changed:46bae571-c4cf-494a-ae5d-a0def33d7330 for instance e2071a11-86aa-4a7f-962c-709f94eb7d6b on hv-cinder-83608 Jun 02 13:38:54.014177 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-28d38694-cbb0-412f-bc78-a6f6a283ed95 req-e4732976-d51d-435d-b28b-4380481994b5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097620 Jun 02 13:38:54.016474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 181/350] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:54.189223 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-353c9f22-0245-4c28-ae36-f858305f022d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:54.202002 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-353c9f22-0245-4c28-ae36-f858305f022d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:54.204010 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-353c9f22-0245-4c28-ae36-f858305f022d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:54.207185 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-353c9f22-0245-4c28-ae36-f858305f022d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.386170 Jun 02 13:38:54.214158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 170/351] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:53 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:54.331757 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f393bf90-350c-4819-94e9-8ff6c042cd80 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:54.334046 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f393bf90-350c-4819-94e9-8ff6c042cd80 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:54.340367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f393bf90-350c-4819-94e9-8ff6c042cd80 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:54.341631 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f393bf90-350c-4819-94e9-8ff6c042cd80 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:54.342410 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f393bf90-350c-4819-94e9-8ff6c042cd80 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:54.342848 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f393bf90-350c-4819-94e9-8ff6c042cd80 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:54.354798 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e441576a-d90d-4466-860e-79a92a9cf876 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:54.355408 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e441576a-d90d-4466-860e-79a92a9cf876 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:54.358608 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:54.362662 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e441576a-d90d-4466-860e-79a92a9cf876 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:54.363109 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e441576a-d90d-4466-860e-79a92a9cf876 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:54.364033 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e441576a-d90d-4466-860e-79a92a9cf876 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:54.364645 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e441576a-d90d-4466-860e-79a92a9cf876 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:54.568695 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f393bf90-350c-4819-94e9-8ff6c042cd80 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:54.578611 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f393bf90-350c-4819-94e9-8ff6c042cd80 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.252824 Jun 02 13:38:54.579453 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 182/352] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:54 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:54.592501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e441576a-d90d-4466-860e-79a92a9cf876 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:54.599975 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e441576a-d90d-4466-860e-79a92a9cf876 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.249018 Jun 02 13:38:54.600550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 171/353] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:54 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:54.720904 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0cfa15ea-d5b5-41e4-a48a-dc9629a9375d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:54.722602 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0cfa15ea-d5b5-41e4-a48a-dc9629a9375d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:54.728462 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0cfa15ea-d5b5-41e4-a48a-dc9629a9375d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:54.728941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0cfa15ea-d5b5-41e4-a48a-dc9629a9375d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:54.729715 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0cfa15ea-d5b5-41e4-a48a-dc9629a9375d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:54.730154 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0cfa15ea-d5b5-41e4-a48a-dc9629a9375d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:54.792327 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0cfa15ea-d5b5-41e4-a48a-dc9629a9375d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:54.795920 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1627d2f1-655f-44c9-90af-6d837554b5a8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:54.796582 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1627d2f1-655f-44c9-90af-6d837554b5a8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:54.800049 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0cfa15ea-d5b5-41e4-a48a-dc9629a9375d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1292 microversion: 2.1 time: 0.082967 Jun 02 13:38:54.800495 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 183/354] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:54 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:54.806596 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1627d2f1-655f-44c9-90af-6d837554b5a8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:54.807133 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1627d2f1-655f-44c9-90af-6d837554b5a8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:54.807978 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1627d2f1-655f-44c9-90af-6d837554b5a8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:54.808682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1627d2f1-655f-44c9-90af-6d837554b5a8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:54.943246 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1627d2f1-655f-44c9-90af-6d837554b5a8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:54.950600 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1627d2f1-655f-44c9-90af-6d837554b5a8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.159559 Jun 02 13:38:54.951163 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 172/355] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:54 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:55.232636 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-302b3fde-c4d4-4542-be9f-0a84b4693a41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:55.233301 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-302b3fde-c4d4-4542-be9f-0a84b4693a41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:55.235886 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:55.247511 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-302b3fde-c4d4-4542-be9f-0a84b4693a41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:55.247971 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-302b3fde-c4d4-4542-be9f-0a84b4693a41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:55.248954 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-302b3fde-c4d4-4542-be9f-0a84b4693a41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:55.249394 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-302b3fde-c4d4-4542-be9f-0a84b4693a41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:55.397645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-302b3fde-c4d4-4542-be9f-0a84b4693a41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:55.405986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-302b3fde-c4d4-4542-be9f-0a84b4693a41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:55.407503 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-302b3fde-c4d4-4542-be9f-0a84b4693a41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:55.409354 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-302b3fde-c4d4-4542-be9f-0a84b4693a41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1745 microversion: 2.20 time: 0.181629 Jun 02 13:38:55.409922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 184/356] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:55 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:55.597114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-69967f56-1f34-43f6-bc6a-d92fc3890dbe tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:55.597644 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-69967f56-1f34-43f6-bc6a-d92fc3890dbe tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:55.604183 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-69967f56-1f34-43f6-bc6a-d92fc3890dbe tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:55.604667 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-69967f56-1f34-43f6-bc6a-d92fc3890dbe tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:55.605438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-69967f56-1f34-43f6-bc6a-d92fc3890dbe tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:55.605887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-69967f56-1f34-43f6-bc6a-d92fc3890dbe tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:55.617075 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c876cfb1-dae8-4303-9368-87ece17347aa tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:55.618595 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c876cfb1-dae8-4303-9368-87ece17347aa tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:55.627067 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c876cfb1-dae8-4303-9368-87ece17347aa tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:55.627836 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c876cfb1-dae8-4303-9368-87ece17347aa tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:55.628672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c876cfb1-dae8-4303-9368-87ece17347aa tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:55.629119 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c876cfb1-dae8-4303-9368-87ece17347aa tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:55.890449 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-69967f56-1f34-43f6-bc6a-d92fc3890dbe tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:55.898381 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-69967f56-1f34-43f6-bc6a-d92fc3890dbe tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.305705 Jun 02 13:38:55.898952 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 173/357] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:55 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:55.904464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2f24bd9f-a49a-4bbd-834c-d83c690bc807 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:55.905123 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2f24bd9f-a49a-4bbd-834c-d83c690bc807 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:55.908769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c876cfb1-dae8-4303-9368-87ece17347aa tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:55.911385 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f24bd9f-a49a-4bbd-834c-d83c690bc807 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:55.911837 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f24bd9f-a49a-4bbd-834c-d83c690bc807 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:55.912646 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f24bd9f-a49a-4bbd-834c-d83c690bc807 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:55.913096 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f24bd9f-a49a-4bbd-834c-d83c690bc807 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:55.916622 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c876cfb1-dae8-4303-9368-87ece17347aa tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.303436 Jun 02 13:38:55.918220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 185/358] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:55 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:55.968858 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f612abe5-e108-444a-8b8e-16f8e0e9a69a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:55.969503 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f612abe5-e108-444a-8b8e-16f8e0e9a69a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:55.976173 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f612abe5-e108-444a-8b8e-16f8e0e9a69a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:55.976667 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f612abe5-e108-444a-8b8e-16f8e0e9a69a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:55.977447 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f612abe5-e108-444a-8b8e-16f8e0e9a69a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:55.977680 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2f24bd9f-a49a-4bbd-834c-d83c690bc807 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:55.977891 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f612abe5-e108-444a-8b8e-16f8e0e9a69a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:55.985260 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2f24bd9f-a49a-4bbd-834c-d83c690bc807 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1310 microversion: 2.1 time: 0.084920 Jun 02 13:38:55.986002 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 174/359] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:55 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:56.112671 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f612abe5-e108-444a-8b8e-16f8e0e9a69a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:56.120221 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f612abe5-e108-444a-8b8e-16f8e0e9a69a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.155750 Jun 02 13:38:56.120816 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 186/360] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:55 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:56.378850 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1a87da7e-36a2-40b4-a8ce-7ccdf2564a12 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:56.386011 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a87da7e-36a2-40b4-a8ce-7ccdf2564a12 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:56.386482 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a87da7e-36a2-40b4-a8ce-7ccdf2564a12 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:56.429588 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bd44b444-a2ec-45de-828d-74840facd452 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:56.430564 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bd44b444-a2ec-45de-828d-74840facd452 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:56.456714 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd44b444-a2ec-45de-828d-74840facd452 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:56.456930 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1a87da7e-36a2-40b4-a8ce-7ccdf2564a12 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Going to try to stop instance {{(pid=124122) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 13:38:56.457750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd44b444-a2ec-45de-828d-74840facd452 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:56.459593 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd44b444-a2ec-45de-828d-74840facd452 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:56.460326 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd44b444-a2ec-45de-828d-74840facd452 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:56.515864 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1a87da7e-36a2-40b4-a8ce-7ccdf2564a12 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/action" status: 202 len: 0 microversion: 2.1 time: 0.141245 Jun 02 13:38:56.516945 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 175/361] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:38:56 2022] POST /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:38:56.526537 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-74cee12a-6115-4b5c-a6be-71280c290aa9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:56.529992 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-74cee12a-6115-4b5c-a6be-71280c290aa9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:56.542387 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74cee12a-6115-4b5c-a6be-71280c290aa9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:56.543193 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74cee12a-6115-4b5c-a6be-71280c290aa9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:56.544541 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74cee12a-6115-4b5c-a6be-71280c290aa9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:56.545109 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74cee12a-6115-4b5c-a6be-71280c290aa9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:56.717834 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bd44b444-a2ec-45de-828d-74840facd452 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:56.726659 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bd44b444-a2ec-45de-828d-74840facd452 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:56.728159 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bd44b444-a2ec-45de-828d-74840facd452 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:56.729415 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bd44b444-a2ec-45de-828d-74840facd452 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1745 microversion: 2.20 time: 0.305048 Jun 02 13:38:56.740323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 187/362] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:56 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1745 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:38:56.740323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-5ff5de04-83d4-4ac1-977b-4b00403a64ef req-2ecf135e-f1cd-41fc-974a-ff001a90db3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15208f-0bda-407c-8ea0-38a1300bfa16", "name": "network-vif-plugged", "status": "completed", "tag": "8aab5ca9-b3de-4176-a679-2976edeca505"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:38:56.747142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-5ff5de04-83d4-4ac1-977b-4b00403a64ef req-2ecf135e-f1cd-41fc-974a-ff001a90db3e service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:56.747656 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-5ff5de04-83d4-4ac1-977b-4b00403a64ef req-2ecf135e-f1cd-41fc-974a-ff001a90db3e service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:56.749087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-74cee12a-6115-4b5c-a6be-71280c290aa9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:56.760796 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-5ff5de04-83d4-4ac1-977b-4b00403a64ef req-2ecf135e-f1cd-41fc-974a-ff001a90db3e service nova] Creating event network-vif-plugged:8aab5ca9-b3de-4176-a679-2976edeca505 for instance bf15208f-0bda-407c-8ea0-38a1300bfa16 on hv-cinder-83608 Jun 02 13:38:56.760985 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-74cee12a-6115-4b5c-a6be-71280c290aa9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.239250 Jun 02 13:38:56.761519 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 176/363] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:56 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:56.766604 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-5ff5de04-83d4-4ac1-977b-4b00403a64ef req-2ecf135e-f1cd-41fc-974a-ff001a90db3e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035493 Jun 02 13:38:56.768463 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 188/364] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:38:56.915042 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c4f2fc2c-4cde-46ff-84b2-f323a7a1406f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:56.915572 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c4f2fc2c-4cde-46ff-84b2-f323a7a1406f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:56.921525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4f2fc2c-4cde-46ff-84b2-f323a7a1406f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:56.921992 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4f2fc2c-4cde-46ff-84b2-f323a7a1406f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:56.922746 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4f2fc2c-4cde-46ff-84b2-f323a7a1406f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:56.923182 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4f2fc2c-4cde-46ff-84b2-f323a7a1406f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:56.937358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-803b6dd3-c0a4-46a6-9514-d1d1a5b8bc3a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:56.938060 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-803b6dd3-c0a4-46a6-9514-d1d1a5b8bc3a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:56.944915 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-803b6dd3-c0a4-46a6-9514-d1d1a5b8bc3a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:56.945362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-803b6dd3-c0a4-46a6-9514-d1d1a5b8bc3a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:56.946129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-803b6dd3-c0a4-46a6-9514-d1d1a5b8bc3a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:56.946598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-803b6dd3-c0a4-46a6-9514-d1d1a5b8bc3a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:57.121998 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c4f2fc2c-4cde-46ff-84b2-f323a7a1406f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:57.125755 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-803b6dd3-c0a4-46a6-9514-d1d1a5b8bc3a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:57.130291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c4f2fc2c-4cde-46ff-84b2-f323a7a1406f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.219169 Jun 02 13:38:57.131357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 177/365] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:56 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:57.133985 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-803b6dd3-c0a4-46a6-9514-d1d1a5b8bc3a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.201436 Jun 02 13:38:57.139886 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 189/366] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:56 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:57.140028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3d56372c-5c02-4dc2-8db0-fc4b51c0c033 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:57.140028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3d56372c-5c02-4dc2-8db0-fc4b51c0c033 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:57.143607 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3d56372c-5c02-4dc2-8db0-fc4b51c0c033 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:57.144069 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3d56372c-5c02-4dc2-8db0-fc4b51c0c033 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:57.144186 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c9b3206d-11c9-485e-82cc-687eed110801 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:57.144752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c9b3206d-11c9-485e-82cc-687eed110801 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:57.144853 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3d56372c-5c02-4dc2-8db0-fc4b51c0c033 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:57.145269 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3d56372c-5c02-4dc2-8db0-fc4b51c0c033 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:57.150737 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9b3206d-11c9-485e-82cc-687eed110801 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:57.151189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9b3206d-11c9-485e-82cc-687eed110801 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:57.151948 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9b3206d-11c9-485e-82cc-687eed110801 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:57.152421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9b3206d-11c9-485e-82cc-687eed110801 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:57.216527 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3d56372c-5c02-4dc2-8db0-fc4b51c0c033 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:57.225012 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3d56372c-5c02-4dc2-8db0-fc4b51c0c033 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1310 microversion: 2.1 time: 0.092580 Jun 02 13:38:57.225571 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 178/367] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:57 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:57.300348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c9b3206d-11c9-485e-82cc-687eed110801 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:57.307779 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c9b3206d-11c9-485e-82cc-687eed110801 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.172110 Jun 02 13:38:57.308390 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 190/368] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:57 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:57.750455 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-25ced477-3ed2-49f3-8ce7-e4943f60dea5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:57.751108 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-25ced477-3ed2-49f3-8ce7-e4943f60dea5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:57.757812 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25ced477-3ed2-49f3-8ce7-e4943f60dea5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:57.758286 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25ced477-3ed2-49f3-8ce7-e4943f60dea5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:57.759048 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25ced477-3ed2-49f3-8ce7-e4943f60dea5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:57.759486 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25ced477-3ed2-49f3-8ce7-e4943f60dea5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:57.778528 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1c9f4e5d-fc6f-4861-975a-deadb58958a4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:57.779145 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1c9f4e5d-fc6f-4861-975a-deadb58958a4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:57.785687 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1c9f4e5d-fc6f-4861-975a-deadb58958a4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:57.786145 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1c9f4e5d-fc6f-4861-975a-deadb58958a4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:57.786915 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1c9f4e5d-fc6f-4861-975a-deadb58958a4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:57.787353 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1c9f4e5d-fc6f-4861-975a-deadb58958a4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:58.190804 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-25ced477-3ed2-49f3-8ce7-e4943f60dea5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:58.200260 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-25ced477-3ed2-49f3-8ce7-e4943f60dea5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:58.201804 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-25ced477-3ed2-49f3-8ce7-e4943f60dea5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:58.201923 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1c9f4e5d-fc6f-4861-975a-deadb58958a4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:58.202973 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-25ced477-3ed2-49f3-8ce7-e4943f60dea5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1745 microversion: 2.20 time: 0.456585 Jun 02 13:38:58.203526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 179/369] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:57 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1745 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:58.209195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4bcefba8-c82d-4fbd-96bd-2eb30b0976ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:58.209806 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4bcefba8-c82d-4fbd-96bd-2eb30b0976ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:58.210759 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1c9f4e5d-fc6f-4861-975a-deadb58958a4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.436076 Jun 02 13:38:58.213875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 191/370] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:57 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:38:58.216823 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-296d3401-0f76-4f5d-98ad-5b0f79773833 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:58.217415 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bcefba8-c82d-4fbd-96bd-2eb30b0976ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:58.217529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-296d3401-0f76-4f5d-98ad-5b0f79773833 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:58.217874 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bcefba8-c82d-4fbd-96bd-2eb30b0976ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:58.218648 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bcefba8-c82d-4fbd-96bd-2eb30b0976ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:58.219093 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bcefba8-c82d-4fbd-96bd-2eb30b0976ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:58.223921 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-296d3401-0f76-4f5d-98ad-5b0f79773833 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:58.224425 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-296d3401-0f76-4f5d-98ad-5b0f79773833 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:58.225200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-296d3401-0f76-4f5d-98ad-5b0f79773833 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:58.225645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-296d3401-0f76-4f5d-98ad-5b0f79773833 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:58.421022 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4bcefba8-c82d-4fbd-96bd-2eb30b0976ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:58.424037 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-296d3401-0f76-4f5d-98ad-5b0f79773833 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:58.428541 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4bcefba8-c82d-4fbd-96bd-2eb30b0976ff tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.223428 Jun 02 13:38:58.429115 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 180/371] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:58 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:58.433725 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-296d3401-0f76-4f5d-98ad-5b0f79773833 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1312 microversion: 2.1 time: 0.220307 Jun 02 13:38:58.443480 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 192/372] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:58 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1312 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:58.443673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a8b1818b-97d1-4034-82b9-df3a12f360bd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:58.443673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a8b1818b-97d1-4034-82b9-df3a12f360bd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:58.443873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0f4847f7-ff0c-43b6-9355-785126e09565 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:58.443873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0f4847f7-ff0c-43b6-9355-785126e09565 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:58.445824 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8b1818b-97d1-4034-82b9-df3a12f360bd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:58.446295 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8b1818b-97d1-4034-82b9-df3a12f360bd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:58.447069 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8b1818b-97d1-4034-82b9-df3a12f360bd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:58.447515 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8b1818b-97d1-4034-82b9-df3a12f360bd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:58.447684 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0f4847f7-ff0c-43b6-9355-785126e09565 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:58.448280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0f4847f7-ff0c-43b6-9355-785126e09565 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:58.449455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0f4847f7-ff0c-43b6-9355-785126e09565 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:58.449922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0f4847f7-ff0c-43b6-9355-785126e09565 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:58.463653 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:38:58.543301 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a8b1818b-97d1-4034-82b9-df3a12f360bd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:58.549446 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a8b1818b-97d1-4034-82b9-df3a12f360bd tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1298 microversion: 2.1 time: 0.119228 Jun 02 13:38:58.550290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 181/373] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:58 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:58.617114 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0f4847f7-ff0c-43b6-9355-785126e09565 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:58.625457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0f4847f7-ff0c-43b6-9355-785126e09565 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1509 microversion: 2.1 time: 0.188768 Jun 02 13:38:58.626224 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 193/374] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:58 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:59.221871 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0312b783-c5ab-471c-8ebc-95d0b145f8b3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:59.222587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0312b783-c5ab-471c-8ebc-95d0b145f8b3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:59.228393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b9f1e280-5e98-4827-8d52-dc11bb3907db tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:59.229503 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b9f1e280-5e98-4827-8d52-dc11bb3907db tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:59.230885 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0312b783-c5ab-471c-8ebc-95d0b145f8b3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.231336 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0312b783-c5ab-471c-8ebc-95d0b145f8b3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.232107 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0312b783-c5ab-471c-8ebc-95d0b145f8b3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.232750 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0312b783-c5ab-471c-8ebc-95d0b145f8b3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.236134 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9f1e280-5e98-4827-8d52-dc11bb3907db tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.236977 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9f1e280-5e98-4827-8d52-dc11bb3907db tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.238205 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9f1e280-5e98-4827-8d52-dc11bb3907db tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.238803 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9f1e280-5e98-4827-8d52-dc11bb3907db tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.446665 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0312b783-c5ab-471c-8ebc-95d0b145f8b3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:59.449046 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b9f1e280-5e98-4827-8d52-dc11bb3907db tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:59.461059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0312b783-c5ab-471c-8ebc-95d0b145f8b3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:59.462227 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b9f1e280-5e98-4827-8d52-dc11bb3907db tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.237921 Jun 02 13:38:59.463143 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 194/375] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:59 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:59.464722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0312b783-c5ab-471c-8ebc-95d0b145f8b3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:59.467725 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1fc4eb66-e32d-4d30-9eb7-85459ae2c84b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:59.468279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0312b783-c5ab-471c-8ebc-95d0b145f8b3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1745 microversion: 2.20 time: 0.250319 Jun 02 13:38:59.468394 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1fc4eb66-e32d-4d30-9eb7-85459ae2c84b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:59.468856 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 182/376] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:38:59 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1745 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:38:59.474822 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1fc4eb66-e32d-4d30-9eb7-85459ae2c84b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.475279 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1fc4eb66-e32d-4d30-9eb7-85459ae2c84b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.476057 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1fc4eb66-e32d-4d30-9eb7-85459ae2c84b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.476525 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1fc4eb66-e32d-4d30-9eb7-85459ae2c84b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.479892 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bda390cb-56b8-48fb-a7f7-b74c75767001 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:59.480625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bda390cb-56b8-48fb-a7f7-b74c75767001 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:59.486752 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda390cb-56b8-48fb-a7f7-b74c75767001 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.487287 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda390cb-56b8-48fb-a7f7-b74c75767001 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.488179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda390cb-56b8-48fb-a7f7-b74c75767001 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.488717 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda390cb-56b8-48fb-a7f7-b74c75767001 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.687645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1fc4eb66-e32d-4d30-9eb7-85459ae2c84b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:59.696587 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1fc4eb66-e32d-4d30-9eb7-85459ae2c84b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.232034 Jun 02 13:38:59.704483 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 195/377] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:59 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:59.704840 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bda390cb-56b8-48fb-a7f7-b74c75767001 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:59.708633 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0ff00699-c8d0-4eac-b6f2-edc5cdf6f167 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:59.709268 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0ff00699-c8d0-4eac-b6f2-edc5cdf6f167 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:59.715672 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bda390cb-56b8-48fb-a7f7-b74c75767001 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1496 microversion: 2.1 time: 0.244017 Jun 02 13:38:59.716273 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 183/378] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:59 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1496 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:59.721407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ff00699-c8d0-4eac-b6f2-edc5cdf6f167 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.721407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ff00699-c8d0-4eac-b6f2-edc5cdf6f167 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.721407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ff00699-c8d0-4eac-b6f2-edc5cdf6f167 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.721407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ff00699-c8d0-4eac-b6f2-edc5cdf6f167 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.727331 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-87728ff3-91fe-4b32-a246-53fa01ef7309 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:38:59.727962 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-87728ff3-91fe-4b32-a246-53fa01ef7309 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:38:59.735100 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87728ff3-91fe-4b32-a246-53fa01ef7309 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.735954 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87728ff3-91fe-4b32-a246-53fa01ef7309 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.736707 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87728ff3-91fe-4b32-a246-53fa01ef7309 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:38:59.737261 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87728ff3-91fe-4b32-a246-53fa01ef7309 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:38:59.809180 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0ff00699-c8d0-4eac-b6f2-edc5cdf6f167 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:59.817614 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0ff00699-c8d0-4eac-b6f2-edc5cdf6f167 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1298 microversion: 2.1 time: 0.119425 Jun 02 13:38:59.818320 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 196/379] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:59 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:38:59.941693 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-87728ff3-91fe-4b32-a246-53fa01ef7309 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:38:59.950482 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-87728ff3-91fe-4b32-a246-53fa01ef7309 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1515 microversion: 2.1 time: 0.233133 Jun 02 13:38:59.951596 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 184/380] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:38:59 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:00.479715 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6ea1a6a2-22a2-4d62-8ff1-de089db6b113 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:00.480348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6ea1a6a2-22a2-4d62-8ff1-de089db6b113 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:00.486341 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-938132d0-af18-4f3c-ab34-2419e28434be tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:00.486971 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-938132d0-af18-4f3c-ab34-2419e28434be tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:00.488130 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6ea1a6a2-22a2-4d62-8ff1-de089db6b113 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.488618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6ea1a6a2-22a2-4d62-8ff1-de089db6b113 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.489392 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6ea1a6a2-22a2-4d62-8ff1-de089db6b113 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.489824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6ea1a6a2-22a2-4d62-8ff1-de089db6b113 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.494685 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-938132d0-af18-4f3c-ab34-2419e28434be tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.495365 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-938132d0-af18-4f3c-ab34-2419e28434be tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.496757 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-938132d0-af18-4f3c-ab34-2419e28434be tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.497363 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-938132d0-af18-4f3c-ab34-2419e28434be tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.720564 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-938132d0-af18-4f3c-ab34-2419e28434be tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:00.724192 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6ea1a6a2-22a2-4d62-8ff1-de089db6b113 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:00.729210 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-938132d0-af18-4f3c-ab34-2419e28434be tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:00.730827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-938132d0-af18-4f3c-ab34-2419e28434be tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:00.732043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-938132d0-af18-4f3c-ab34-2419e28434be tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1745 microversion: 2.20 time: 0.249585 Jun 02 13:39:00.732706 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 185/381] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:00 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1745 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:00.732813 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6ea1a6a2-22a2-4d62-8ff1-de089db6b113 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.256868 Jun 02 13:39:00.736693 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 197/382] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:00 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:00.736967 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4537c6af-4be7-4c92-88b6-c5cd05a5ee9f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:00.737532 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4537c6af-4be7-4c92-88b6-c5cd05a5ee9f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:00.742005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8e3814b6-cbb2-4836-898f-db114917265f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:00.742726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8e3814b6-cbb2-4836-898f-db114917265f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:00.744515 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4537c6af-4be7-4c92-88b6-c5cd05a5ee9f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.744962 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4537c6af-4be7-4c92-88b6-c5cd05a5ee9f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.745886 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4537c6af-4be7-4c92-88b6-c5cd05a5ee9f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.746323 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4537c6af-4be7-4c92-88b6-c5cd05a5ee9f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.749749 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e3814b6-cbb2-4836-898f-db114917265f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.751671 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e3814b6-cbb2-4836-898f-db114917265f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.752703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e3814b6-cbb2-4836-898f-db114917265f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.755044 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e3814b6-cbb2-4836-898f-db114917265f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.772150 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4537c6af-4be7-4c92-88b6-c5cd05a5ee9f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:39:00.858099 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4537c6af-4be7-4c92-88b6-c5cd05a5ee9f tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 204 len: 0 microversion: 2.1 time: 0.124165 Jun 02 13:39:00.858695 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 186/383] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:39:00 2022] DELETE /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:39:00.864097 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8597847d-324c-4288-9b89-c2ee011c5364 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:00.864945 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8597847d-324c-4288-9b89-c2ee011c5364 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:00.871285 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8597847d-324c-4288-9b89-c2ee011c5364 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.871800 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8597847d-324c-4288-9b89-c2ee011c5364 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.872634 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8597847d-324c-4288-9b89-c2ee011c5364 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.873216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8597847d-324c-4288-9b89-c2ee011c5364 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.900794 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8e3814b6-cbb2-4836-898f-db114917265f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:00.908385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8e3814b6-cbb2-4836-898f-db114917265f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.169874 Jun 02 13:39:00.909494 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 198/384] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:00 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:00.924910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-aefa0ffb-a696-4747-8c5d-273daf981196 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:00.925928 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-aefa0ffb-a696-4747-8c5d-273daf981196 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:00.934226 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aefa0ffb-a696-4747-8c5d-273daf981196 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.935344 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aefa0ffb-a696-4747-8c5d-273daf981196 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:00.936133 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aefa0ffb-a696-4747-8c5d-273daf981196 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:00.936605 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aefa0ffb-a696-4747-8c5d-273daf981196 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:01.128071 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8597847d-324c-4288-9b89-c2ee011c5364 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:01.140241 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-aefa0ffb-a696-4747-8c5d-273daf981196 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:01.141057 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8597847d-324c-4288-9b89-c2ee011c5364 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.281083 Jun 02 13:39:01.141751 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 187/385] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:00 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:01.142621 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:01.150942 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-aefa0ffb-a696-4747-8c5d-273daf981196 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1502 microversion: 2.1 time: 0.238058 Jun 02 13:39:01.150942 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 199/386] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:00 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:01.344625 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-157b17f7-d8aa-4f50-96ae-200c76964753 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'create', calling method: .version_select at 0x7f8615287af0>, body: {"keypair": {"name": "tempest-keypair-1392736319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6jKtMx21pwSJCSSB217BSS4pqpadV4OhHO9fKMX3TTARBEtahX8jlQRLr8w5YOe/D2cFnVlIRk160S5blWZr5lay8laJG3UpkSc+7QA7G1tYe//Fp3Gqy00Tei54JRLw=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:01.358446 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-157b17f7-d8aa-4f50-96ae-200c76964753 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Getting quotas for project ff89a4ee01d444d2aee3bdc9199d556f. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:39:01.363665 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-157b17f7-d8aa-4f50-96ae-200c76964753 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Getting quotas for user b92da35ea7c946ea876b13b13ed98258 and project ff89a4ee01d444d2aee3bdc9199d556f. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:39:01.386558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-157b17f7-d8aa-4f50-96ae-200c76964753 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045952 Jun 02 13:39:01.387142 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 188/387] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Jun 2 13:39:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:39:01.647451 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-df63c351-44bc-4c50-9021-63e6d1d43af2 req-e407ee3a-f8a8-4eaa-bc1c-a96d041545db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec", "tag": "94186e6c-fc85-41ca-ae77-bd755f5fceed"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:01.660789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-df63c351-44bc-4c50-9021-63e6d1d43af2 req-e407ee3a-f8a8-4eaa-bc1c-a96d041545db service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:01.667386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-df63c351-44bc-4c50-9021-63e6d1d43af2 req-e407ee3a-f8a8-4eaa-bc1c-a96d041545db service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:01.681963 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-df63c351-44bc-4c50-9021-63e6d1d43af2 req-e407ee3a-f8a8-4eaa-bc1c-a96d041545db service nova] Creating event network-changed:94186e6c-fc85-41ca-ae77-bd755f5fceed for instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec on hv-cinder-83608 Jun 02 13:39:01.688703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-df63c351-44bc-4c50-9021-63e6d1d43af2 req-e407ee3a-f8a8-4eaa-bc1c-a96d041545db service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045557 Jun 02 13:39:01.689752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 200/388] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:39:01.754529 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d0d6ed00-8aac-41d4-9361-38e8e0fdc9e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:01.755315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d0d6ed00-8aac-41d4-9361-38e8e0fdc9e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:01.763491 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0d6ed00-8aac-41d4-9361-38e8e0fdc9e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:01.763770 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7de99544-0bc2-4b41-9dbb-498f0e3a7be0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:01.764014 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0d6ed00-8aac-41d4-9361-38e8e0fdc9e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:01.765162 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7de99544-0bc2-4b41-9dbb-498f0e3a7be0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:01.765644 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0d6ed00-8aac-41d4-9361-38e8e0fdc9e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:01.766093 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0d6ed00-8aac-41d4-9361-38e8e0fdc9e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:01.774415 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7de99544-0bc2-4b41-9dbb-498f0e3a7be0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:01.775128 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7de99544-0bc2-4b41-9dbb-498f0e3a7be0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:01.776223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7de99544-0bc2-4b41-9dbb-498f0e3a7be0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:01.776892 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7de99544-0bc2-4b41-9dbb-498f0e3a7be0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:02.028933 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d0d6ed00-8aac-41d4-9361-38e8e0fdc9e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:02.031686 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7de99544-0bc2-4b41-9dbb-498f0e3a7be0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:02.037885 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d0d6ed00-8aac-41d4-9361-38e8e0fdc9e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.288001 Jun 02 13:39:02.039081 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 189/389] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:01 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:02.040995 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7de99544-0bc2-4b41-9dbb-498f0e3a7be0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:02.042698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7de99544-0bc2-4b41-9dbb-498f0e3a7be0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:02.044016 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7de99544-0bc2-4b41-9dbb-498f0e3a7be0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.287325 Jun 02 13:39:02.044236 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-47cc9e5b-ab07-4bed-9329-dc05d684d7db tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:02.044971 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-47cc9e5b-ab07-4bed-9329-dc05d684d7db tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:02.051704 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-47cc9e5b-ab07-4bed-9329-dc05d684d7db tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:02.052337 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-47cc9e5b-ab07-4bed-9329-dc05d684d7db tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:02.053189 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-47cc9e5b-ab07-4bed-9329-dc05d684d7db tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:02.053734 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-47cc9e5b-ab07-4bed-9329-dc05d684d7db tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:02.056447 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 201/390] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:01 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:02.158862 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-48ad90a4-fe98-4a92-af44-9728666e1679 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:02.160488 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-48ad90a4-fe98-4a92-af44-9728666e1679 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:02.166591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-48ad90a4-fe98-4a92-af44-9728666e1679 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:02.167358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-48ad90a4-fe98-4a92-af44-9728666e1679 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:02.168615 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-48ad90a4-fe98-4a92-af44-9728666e1679 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:02.169112 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-48ad90a4-fe98-4a92-af44-9728666e1679 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:02.202597 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-47cc9e5b-ab07-4bed-9329-dc05d684d7db tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:02.213049 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-47cc9e5b-ab07-4bed-9329-dc05d684d7db tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.172688 Jun 02 13:39:02.213889 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 190/391] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:02 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:02.219613 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3a8bd591-48c4-4df5-a07a-afab72e3a00b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:02.220233 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3a8bd591-48c4-4df5-a07a-afab72e3a00b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:02.222749 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:02.228318 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a8bd591-48c4-4df5-a07a-afab72e3a00b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:02.228795 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a8bd591-48c4-4df5-a07a-afab72e3a00b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:02.229598 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a8bd591-48c4-4df5-a07a-afab72e3a00b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:02.230035 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a8bd591-48c4-4df5-a07a-afab72e3a00b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:02.369750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-48ad90a4-fe98-4a92-af44-9728666e1679 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:02.377322 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-48ad90a4-fe98-4a92-af44-9728666e1679 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.222254 Jun 02 13:39:02.378000 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 202/392] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:02 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:02.401048 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a8bd591-48c4-4df5-a07a-afab72e3a00b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:02.408541 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3a8bd591-48c4-4df5-a07a-afab72e3a00b tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1502 microversion: 2.1 time: 0.193230 Jun 02 13:39:02.409106 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 191/393] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:02 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:02.906218 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2029954940", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3b71a2c-b260-4c3e-88e4-93261c3bf9d1"}], "security_groups": [{"name": "tempest-securitygroup--1101711832"}], "key_name": "tempest-keypair-1392736319", "user_data": "}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:03.016099 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] validate_networks() for [('f3b71a2c-b260-4c3e-88e4-93261c3bf9d1', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:39:03.055473 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9c2ecf8e-3615-4678-b4ef-0efaba8406ce tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:03.056102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9c2ecf8e-3615-4678-b4ef-0efaba8406ce tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:03.063213 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c2ecf8e-3615-4678-b4ef-0efaba8406ce tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:03.063673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c2ecf8e-3615-4678-b4ef-0efaba8406ce tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:03.064477 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c2ecf8e-3615-4678-b4ef-0efaba8406ce tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:03.064931 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c2ecf8e-3615-4678-b4ef-0efaba8406ce tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:03.301814 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9c2ecf8e-3615-4678-b4ef-0efaba8406ce tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:03.311185 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9c2ecf8e-3615-4678-b4ef-0efaba8406ce tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.259472 Jun 02 13:39:03.321390 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 192/394] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:03 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:03.328064 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5a539ab5-7e02-4426-a0ce-ac68994b1834 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:03.328885 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5a539ab5-7e02-4426-a0ce-ac68994b1834 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:03.335948 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a539ab5-7e02-4426-a0ce-ac68994b1834 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:03.336602 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a539ab5-7e02-4426-a0ce-ac68994b1834 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:03.337542 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a539ab5-7e02-4426-a0ce-ac68994b1834 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:03.337988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a539ab5-7e02-4426-a0ce-ac68994b1834 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:03.697210 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5a539ab5-7e02-4426-a0ce-ac68994b1834 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:03.710881 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5a539ab5-7e02-4426-a0ce-ac68994b1834 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:03.713381 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5a539ab5-7e02-4426-a0ce-ac68994b1834 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:03.715800 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5a539ab5-7e02-4426-a0ce-ac68994b1834 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.393075 Jun 02 13:39:03.717495 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 193/395] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:03 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:03.723688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-40d44bb7-451d-4d1f-8b38-c90ad62f276a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:03.725621 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-40d44bb7-451d-4d1f-8b38-c90ad62f276a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:03.739270 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40d44bb7-451d-4d1f-8b38-c90ad62f276a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:03.740271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40d44bb7-451d-4d1f-8b38-c90ad62f276a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:03.741913 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40d44bb7-451d-4d1f-8b38-c90ad62f276a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:03.742592 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40d44bb7-451d-4d1f-8b38-c90ad62f276a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:03.764830 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:39:03.765253 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:39:03.765728 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:39:03.766136 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:39:03.766549 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:39:03.777961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:03.778668 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:03.779635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:03.780269 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:03.817342 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Getting quotas for project ff89a4ee01d444d2aee3bdc9199d556f. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:39:03.821769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Getting quotas for user b92da35ea7c946ea876b13b13ed98258 and project ff89a4ee01d444d2aee3bdc9199d556f. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:39:03.835516 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:39:03.838083 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:39:03.920861 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5a387847-1f17-4a41-95b5-5f7abf45187f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.014583 Jun 02 13:39:03.922688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-40d44bb7-451d-4d1f-8b38-c90ad62f276a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:03.923581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 203/396] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:39:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:39:03.929837 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7cfd6be7-9c81-4642-9de4-98a4fd74c234 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:03.931241 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7cfd6be7-9c81-4642-9de4-98a4fd74c234 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:03.932051 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-40d44bb7-451d-4d1f-8b38-c90ad62f276a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.213014 Jun 02 13:39:03.932734 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 194/397] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:03 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:03.945647 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-10d433f2-94ea-47ba-a136-8ea0f6db7957 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:03.952028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-10d433f2-94ea-47ba-a136-8ea0f6db7957 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:03.956245 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7cfd6be7-9c81-4642-9de4-98a4fd74c234 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:03.957360 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7cfd6be7-9c81-4642-9de4-98a4fd74c234 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:03.958138 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7cfd6be7-9c81-4642-9de4-98a4fd74c234 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:03.958767 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7cfd6be7-9c81-4642-9de4-98a4fd74c234 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:04.002501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10d433f2-94ea-47ba-a136-8ea0f6db7957 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:04.002924 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10d433f2-94ea-47ba-a136-8ea0f6db7957 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:04.006585 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10d433f2-94ea-47ba-a136-8ea0f6db7957 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:04.007063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10d433f2-94ea-47ba-a136-8ea0f6db7957 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:04.144274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-10d433f2-94ea-47ba-a136-8ea0f6db7957 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:04.173114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-10d433f2-94ea-47ba-a136-8ea0f6db7957 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1460 microversion: 2.1 time: 0.239248 Jun 02 13:39:04.173953 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 195/398] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:03 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1460 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:04.214360 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-87425792-ccba-49b6-af0a-69585c91694a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:04.214998 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-87425792-ccba-49b6-af0a-69585c91694a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:04.269303 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7cfd6be7-9c81-4642-9de4-98a4fd74c234 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:04.292341 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7cfd6be7-9c81-4642-9de4-98a4fd74c234 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.359596 Jun 02 13:39:04.292341 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 204/399] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:03 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:04.301464 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-1a8d3acb-30b4-47dd-88d7-69f022bf7b6c req-2cc50397-06dd-40e8-a60b-7607ecf2490d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f02e5114-86e5-4424-8292-712d26240714", "name": "network-vif-deleted", "tag": "fe8296ca-30ec-4dc0-8351-177e7bb79353"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:04.319554 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-1a8d3acb-30b4-47dd-88d7-69f022bf7b6c req-2cc50397-06dd-40e8-a60b-7607ecf2490d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:04.320006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-1a8d3acb-30b4-47dd-88d7-69f022bf7b6c req-2cc50397-06dd-40e8-a60b-7607ecf2490d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:04.324944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-87425792-ccba-49b6-af0a-69585c91694a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:04.337388 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-87425792-ccba-49b6-af0a-69585c91694a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1246 microversion: 2.1 time: 0.154571 Jun 02 13:39:04.347906 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-1a8d3acb-30b4-47dd-88d7-69f022bf7b6c req-2cc50397-06dd-40e8-a60b-7607ecf2490d service nova] Creating event network-vif-deleted:fe8296ca-30ec-4dc0-8351-177e7bb79353 for instance f02e5114-86e5-4424-8292-712d26240714 on hv-cinder-83608 Jun 02 13:39:04.352610 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-1a8d3acb-30b4-47dd-88d7-69f022bf7b6c req-2cc50397-06dd-40e8-a60b-7607ecf2490d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061836 Jun 02 13:39:04.353700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 205/400] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:04.359798 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e4e3ab7b-83d4-4dea-ab2a-884bb16613b6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:04.360645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e4e3ab7b-83d4-4dea-ab2a-884bb16613b6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:04.360819 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 196/401] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:04 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1246 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:04.372888 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4e3ab7b-83d4-4dea-ab2a-884bb16613b6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:04.374204 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4e3ab7b-83d4-4dea-ab2a-884bb16613b6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:04.375146 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4e3ab7b-83d4-4dea-ab2a-884bb16613b6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:04.375661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4e3ab7b-83d4-4dea-ab2a-884bb16613b6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:04.613731 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e4e3ab7b-83d4-4dea-ab2a-884bb16613b6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:04.622973 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e4e3ab7b-83d4-4dea-ab2a-884bb16613b6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.267878 Jun 02 13:39:04.634023 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 206/402] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:04 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:04.737991 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2e85f095-81fe-4660-b418-55d855e5fe23 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:04.738772 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2e85f095-81fe-4660-b418-55d855e5fe23 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:04.746558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2e85f095-81fe-4660-b418-55d855e5fe23 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:04.746558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2e85f095-81fe-4660-b418-55d855e5fe23 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:04.747295 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2e85f095-81fe-4660-b418-55d855e5fe23 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:04.747749 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2e85f095-81fe-4660-b418-55d855e5fe23 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:04.909992 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2e85f095-81fe-4660-b418-55d855e5fe23 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:04.918725 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2e85f095-81fe-4660-b418-55d855e5fe23 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:04.921206 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2e85f095-81fe-4660-b418-55d855e5fe23 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:04.922376 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2e85f095-81fe-4660-b418-55d855e5fe23 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.189011 Jun 02 13:39:04.922934 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 197/403] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:04 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:04.979564 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-60102d34-3b0d-4acf-89f5-7be9f7b1df33 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:04.981527 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-60102d34-3b0d-4acf-89f5-7be9f7b1df33 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:04.991552 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-60102d34-3b0d-4acf-89f5-7be9f7b1df33 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:04.992485 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-60102d34-3b0d-4acf-89f5-7be9f7b1df33 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:04.993560 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-60102d34-3b0d-4acf-89f5-7be9f7b1df33 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:04.994236 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-60102d34-3b0d-4acf-89f5-7be9f7b1df33 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:05.181189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-60102d34-3b0d-4acf-89f5-7be9f7b1df33 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:05.191735 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e5b01a1e-1ac7-4d8f-886f-84af52982e9a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:05.192369 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-60102d34-3b0d-4acf-89f5-7be9f7b1df33 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.245798 Jun 02 13:39:05.201327 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 207/404] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:04 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:05.202949 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e5b01a1e-1ac7-4d8f-886f-84af52982e9a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:05.213172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5b01a1e-1ac7-4d8f-886f-84af52982e9a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:05.213782 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5b01a1e-1ac7-4d8f-886f-84af52982e9a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:05.214656 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5b01a1e-1ac7-4d8f-886f-84af52982e9a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:05.215199 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5b01a1e-1ac7-4d8f-886f-84af52982e9a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:05.231473 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:05.290810 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e5b01a1e-1ac7-4d8f-886f-84af52982e9a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:05.309907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-506a4351-3135-4005-96f3-607a0b7f65ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:05.310584 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-506a4351-3135-4005-96f3-607a0b7f65ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:05.318935 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e5b01a1e-1ac7-4d8f-886f-84af52982e9a tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1460 microversion: 2.1 time: 0.131751 Jun 02 13:39:05.322386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 198/405] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:05 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1460 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:05.323279 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-506a4351-3135-4005-96f3-607a0b7f65ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:05.324097 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-506a4351-3135-4005-96f3-607a0b7f65ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:05.324984 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-506a4351-3135-4005-96f3-607a0b7f65ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:05.325492 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-506a4351-3135-4005-96f3-607a0b7f65ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:05.355157 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8ea51716-a202-4ecf-b305-76baa4ddd222 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:05.355762 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8ea51716-a202-4ecf-b305-76baa4ddd222 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:05.367264 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8ea51716-a202-4ecf-b305-76baa4ddd222 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:05.370636 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8ea51716-a202-4ecf-b305-76baa4ddd222 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:05.371886 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8ea51716-a202-4ecf-b305-76baa4ddd222 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:05.372389 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8ea51716-a202-4ecf-b305-76baa4ddd222 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:05.471465 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8ea51716-a202-4ecf-b305-76baa4ddd222 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:05.502851 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8ea51716-a202-4ecf-b305-76baa4ddd222 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1250 microversion: 2.1 time: 0.151480 Jun 02 13:39:05.505691 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 199/406] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:05 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1250 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:05.576069 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-506a4351-3135-4005-96f3-607a0b7f65ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:05.585984 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-506a4351-3135-4005-96f3-607a0b7f65ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.279824 Jun 02 13:39:05.586768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 208/407] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:05 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:05.644174 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3a5f1072-9543-40a5-922a-d4d1648929f5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:05.644871 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3a5f1072-9543-40a5-922a-d4d1648929f5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:05.657495 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a5f1072-9543-40a5-922a-d4d1648929f5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:05.658114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a5f1072-9543-40a5-922a-d4d1648929f5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:05.659092 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a5f1072-9543-40a5-922a-d4d1648929f5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:05.662018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a5f1072-9543-40a5-922a-d4d1648929f5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:05.843867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a5f1072-9543-40a5-922a-d4d1648929f5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:05.854899 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3a5f1072-9543-40a5-922a-d4d1648929f5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.216766 Jun 02 13:39:05.855483 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 200/408] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:05 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:05.942042 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fd2dd7d1-4f63-402e-bf11-e998dd9b0f65 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:05.942806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fd2dd7d1-4f63-402e-bf11-e998dd9b0f65 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:05.950091 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fd2dd7d1-4f63-402e-bf11-e998dd9b0f65 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:05.950921 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fd2dd7d1-4f63-402e-bf11-e998dd9b0f65 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:05.952010 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fd2dd7d1-4f63-402e-bf11-e998dd9b0f65 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:05.952570 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fd2dd7d1-4f63-402e-bf11-e998dd9b0f65 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:06.158627 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fd2dd7d1-4f63-402e-bf11-e998dd9b0f65 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:06.172870 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fd2dd7d1-4f63-402e-bf11-e998dd9b0f65 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:06.174361 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fd2dd7d1-4f63-402e-bf11-e998dd9b0f65 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:06.175566 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fd2dd7d1-4f63-402e-bf11-e998dd9b0f65 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.238183 Jun 02 13:39:06.176109 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 209/409] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:05 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:06.213933 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-124b403c-fd70-4307-a0e6-b48fd91ae01e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:06.214842 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-124b403c-fd70-4307-a0e6-b48fd91ae01e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:06.227210 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-124b403c-fd70-4307-a0e6-b48fd91ae01e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:06.227953 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-124b403c-fd70-4307-a0e6-b48fd91ae01e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:06.228772 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-124b403c-fd70-4307-a0e6-b48fd91ae01e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:06.229383 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-124b403c-fd70-4307-a0e6-b48fd91ae01e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:06.340445 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:06.341520 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:06.348616 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:06.349286 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:06.350104 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:06.350612 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:06.399344 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:06.399809 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:06.400278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lazy-loading 'fault' on Instance uuid f02e5114-86e5-4424-8292-712d26240714 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:39:06.771177 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351177553054eeebc4c60abcfecfa70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46301efc51224c3db7660777fac426b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:06.781833 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-12009fdb-480e-4dd7-afd4-c0ffc9d38971 tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 200 len: 1302 microversion: 2.1 time: 0.444179 Jun 02 13:39:06.794789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 210/410] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:06 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 1302 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:06.802894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-67baf81d-1bf9-449f-95d3-82c58a64a851 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:06.803889 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-67baf81d-1bf9-449f-95d3-82c58a64a851 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:06.813771 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67baf81d-1bf9-449f-95d3-82c58a64a851 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:06.814912 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67baf81d-1bf9-449f-95d3-82c58a64a851 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:06.816975 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67baf81d-1bf9-449f-95d3-82c58a64a851 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:06.817724 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-67baf81d-1bf9-449f-95d3-82c58a64a851 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:06.989884 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-124b403c-fd70-4307-a0e6-b48fd91ae01e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:06.998384 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-124b403c-fd70-4307-a0e6-b48fd91ae01e tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.792257 Jun 02 13:39:07.013147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 201/411] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:06 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:07.024070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b9b97f56-4781-4e4d-a900-60d572c093cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:07.024730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b9b97f56-4781-4e4d-a900-60d572c093cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:07.032163 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-67baf81d-1bf9-449f-95d3-82c58a64a851 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:07.038088 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9b97f56-4781-4e4d-a900-60d572c093cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:07.038585 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9b97f56-4781-4e4d-a900-60d572c093cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:07.046070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9b97f56-4781-4e4d-a900-60d572c093cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:07.046618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9b97f56-4781-4e4d-a900-60d572c093cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:07.047251 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-67baf81d-1bf9-449f-95d3-82c58a64a851 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1306 microversion: 2.1 time: 0.248158 Jun 02 13:39:07.051594 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 211/412] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:06 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1306 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:07.061684 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-64923577-8d63-4d4b-90e7-ee8a22b70315 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:07.065133 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-64923577-8d63-4d4b-90e7-ee8a22b70315 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:07.077123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-64923577-8d63-4d4b-90e7-ee8a22b70315 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:07.077607 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-64923577-8d63-4d4b-90e7-ee8a22b70315 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:07.079538 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-64923577-8d63-4d4b-90e7-ee8a22b70315 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:07.080437 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-64923577-8d63-4d4b-90e7-ee8a22b70315 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:07.300970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b9b97f56-4781-4e4d-a900-60d572c093cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:07.310210 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b9b97f56-4781-4e4d-a900-60d572c093cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.291929 Jun 02 13:39:07.321416 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 202/413] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:07 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:07.327636 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-64923577-8d63-4d4b-90e7-ee8a22b70315 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:07.331163 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4b336a02-f09a-4155-9c10-f659934a4eb6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:07.332139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4b336a02-f09a-4155-9c10-f659934a4eb6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:07.338738 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b336a02-f09a-4155-9c10-f659934a4eb6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:07.339585 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b336a02-f09a-4155-9c10-f659934a4eb6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:07.340676 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b336a02-f09a-4155-9c10-f659934a4eb6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:07.341381 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b336a02-f09a-4155-9c10-f659934a4eb6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:07.342106 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-64923577-8d63-4d4b-90e7-ee8a22b70315 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.288856 Jun 02 13:39:07.351693 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 212/414] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:07 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:07.539793 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4b336a02-f09a-4155-9c10-f659934a4eb6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:07.547835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4b336a02-f09a-4155-9c10-f659934a4eb6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:07.549474 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4b336a02-f09a-4155-9c10-f659934a4eb6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:07.551302 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4b336a02-f09a-4155-9c10-f659934a4eb6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.228430 Jun 02 13:39:07.551934 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 203/415] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:07 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:07.804444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4cb67722-e25e-4fbf-bd3f-33e012fa17ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:07.804444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4cb67722-e25e-4fbf-bd3f-33e012fa17ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] [instance: f02e5114-86e5-4424-8292-712d26240714] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:07.810948 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4cb67722-e25e-4fbf-bd3f-33e012fa17ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:07.811420 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4cb67722-e25e-4fbf-bd3f-33e012fa17ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:07.812380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4cb67722-e25e-4fbf-bd3f-33e012fa17ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:07.812820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4cb67722-e25e-4fbf-bd3f-33e012fa17ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:07.827658 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-4cb67722-e25e-4fbf-bd3f-33e012fa17ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] HTTP exception thrown: Instance f02e5114-86e5-4424-8292-712d26240714 could not be found. Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4cb67722-e25e-4fbf-bd3f-33e012fa17ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Request method failure captured: Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 HTTP/1.1 Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimL002758t7dCcz2s5KvKeyCu2_wYJWCR9L4TF21HbtEo8kRl3UMCLLe3YIFOzSrVYwVBZ5Zx6mtX_mcWjCIsPsLgsJAurKqvk5VtV04VYy2_mVTpWlq-OszR7k6CTXSSFeqv-v9F3Lbg8sbgMaOZ_erpRP8UX7TA-Op20JbxE6bNyKw Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 46301efc51224c3db7660777fac426b2 Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesActionsTest-1204238887 Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:39:07.829548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/46301efc51224c3db7660777fac426b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_46301efc51224c3db7660777fac426b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/46301efc51224c3db7660777fac426b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/46301efc51224c3db7660777fac426b2"}]}] Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesActionsTest-1204238887 Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 46301efc51224c3db7660777fac426b2 Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesActionsTest-1204238887 Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesActionsTest-1204238887-project Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 2351177553054eeebc4c60abcfecfa70 Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesActionsTest-1204238887-project Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance f02e5114-86e5-4424-8292-712d26240714 could not be found. Jun 02 13:39:07.833246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'f02e5114-86e5-4424-8292-712d26240714'} Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f02e5114-86e5-4424-8292-712d26240714 could not be found. Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:39:07.834902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f02e5114-86e5-4424-8292-712d26240714 could not be found. Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f02e5114-86e5-4424-8292-712d26240714 could not be found. Jun 02 13:39:07.838362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:39:07.841444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4cb67722-e25e-4fbf-bd3f-33e012fa17ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] Returning 404 to user: Instance f02e5114-86e5-4424-8292-712d26240714 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:39:07.841444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4cb67722-e25e-4fbf-bd3f-33e012fa17ec tempest-VolumesActionsTest-1204238887 tempest-VolumesActionsTest-1204238887-project] 10.222.0.32 "GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714" status: 404 len: 111 microversion: 2.1 time: 0.032422 Jun 02 13:39:07.841444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 213/416] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:07 2022] GET /compute/v2.1/servers/f02e5114-86e5-4424-8292-712d26240714 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:39:08.015981 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cd437fcf-ed67-4041-a6b4-fd0e33383498 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:08.015981 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cd437fcf-ed67-4041-a6b4-fd0e33383498 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:08.031548 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd437fcf-ed67-4041-a6b4-fd0e33383498 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.032392 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd437fcf-ed67-4041-a6b4-fd0e33383498 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.033378 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd437fcf-ed67-4041-a6b4-fd0e33383498 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.033820 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd437fcf-ed67-4041-a6b4-fd0e33383498 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.067902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0fb75454-cc3e-424a-b5f2-f37eccaea263 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:08.068974 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0fb75454-cc3e-424a-b5f2-f37eccaea263 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:08.078746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0fb75454-cc3e-424a-b5f2-f37eccaea263 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.091635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0fb75454-cc3e-424a-b5f2-f37eccaea263 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.093986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0fb75454-cc3e-424a-b5f2-f37eccaea263 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.094682 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0fb75454-cc3e-424a-b5f2-f37eccaea263 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.202109 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0fb75454-cc3e-424a-b5f2-f37eccaea263 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:08.219870 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0fb75454-cc3e-424a-b5f2-f37eccaea263 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1304 microversion: 2.1 time: 0.155612 Jun 02 13:39:08.220776 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 214/417] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:08 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1304 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:08.289600 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cd437fcf-ed67-4041-a6b4-fd0e33383498 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:08.304666 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cd437fcf-ed67-4041-a6b4-fd0e33383498 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.293016 Jun 02 13:39:08.306389 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 204/418] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:08 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:08.332142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c3c1b61c-82a3-4150-94ad-14a7d20b8db2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:08.335099 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c3c1b61c-82a3-4150-94ad-14a7d20b8db2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:08.342280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3c1b61c-82a3-4150-94ad-14a7d20b8db2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.343057 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3c1b61c-82a3-4150-94ad-14a7d20b8db2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.344376 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3c1b61c-82a3-4150-94ad-14a7d20b8db2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.345040 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3c1b61c-82a3-4150-94ad-14a7d20b8db2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.367654 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-74561ade-2563-442a-b453-c314d08fe4ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:08.370758 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-74561ade-2563-442a-b453-c314d08fe4ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:08.392718 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74561ade-2563-442a-b453-c314d08fe4ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.396410 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74561ade-2563-442a-b453-c314d08fe4ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.400879 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74561ade-2563-442a-b453-c314d08fe4ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.408517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74561ade-2563-442a-b453-c314d08fe4ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.746317 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c3c1b61c-82a3-4150-94ad-14a7d20b8db2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:08.756201 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c3c1b61c-82a3-4150-94ad-14a7d20b8db2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.428931 Jun 02 13:39:08.772224 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 215/419] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:08 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:08.777629 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b5e5f6ba-cc16-41c7-a480-8fdda72d37cb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:08.781109 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b5e5f6ba-cc16-41c7-a480-8fdda72d37cb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:08.787492 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b5e5f6ba-cc16-41c7-a480-8fdda72d37cb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.787929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b5e5f6ba-cc16-41c7-a480-8fdda72d37cb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.788750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b5e5f6ba-cc16-41c7-a480-8fdda72d37cb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.789190 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b5e5f6ba-cc16-41c7-a480-8fdda72d37cb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.819730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-74561ade-2563-442a-b453-c314d08fe4ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:08.828674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-74561ade-2563-442a-b453-c314d08fe4ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.472852 Jun 02 13:39:08.829888 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 205/420] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:08 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:08.842395 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-4c3a82eb-c2b0-4dcd-ab99-f432c58c3cb1 req-22718b66-7ac1-4462-a404-4985baeb6c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2071a11-86aa-4a7f-962c-709f94eb7d6b", "name": "network-vif-plugged", "status": "completed", "tag": "46bae571-c4cf-494a-ae5d-a0def33d7330"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:08.855404 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-4c3a82eb-c2b0-4dcd-ab99-f432c58c3cb1 req-22718b66-7ac1-4462-a404-4985baeb6c6f service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:08.857039 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-4c3a82eb-c2b0-4dcd-ab99-f432c58c3cb1 req-22718b66-7ac1-4462-a404-4985baeb6c6f service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:08.897362 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-4c3a82eb-c2b0-4dcd-ab99-f432c58c3cb1 req-22718b66-7ac1-4462-a404-4985baeb6c6f service nova] Creating event network-vif-plugged:46bae571-c4cf-494a-ae5d-a0def33d7330 for instance e2071a11-86aa-4a7f-962c-709f94eb7d6b on hv-cinder-83608 Jun 02 13:39:08.911033 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-4c3a82eb-c2b0-4dcd-ab99-f432c58c3cb1 req-22718b66-7ac1-4462-a404-4985baeb6c6f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079801 Jun 02 13:39:08.917216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 206/421] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:09.050402 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b5e5f6ba-cc16-41c7-a480-8fdda72d37cb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:09.059656 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b5e5f6ba-cc16-41c7-a480-8fdda72d37cb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:09.061407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b5e5f6ba-cc16-41c7-a480-8fdda72d37cb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:09.062667 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b5e5f6ba-cc16-41c7-a480-8fdda72d37cb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.289404 Jun 02 13:39:09.063569 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 216/422] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:08 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:09.237235 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d7d09888-25a7-4db2-9eb7-b1a2a58f2e58 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:09.238220 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d7d09888-25a7-4db2-9eb7-b1a2a58f2e58 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:09.259122 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7d09888-25a7-4db2-9eb7-b1a2a58f2e58 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:09.259942 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7d09888-25a7-4db2-9eb7-b1a2a58f2e58 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:09.260994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7d09888-25a7-4db2-9eb7-b1a2a58f2e58 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:09.261622 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7d09888-25a7-4db2-9eb7-b1a2a58f2e58 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:09.324473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7182c374-f829-4925-8e74-111b936716b9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:09.324473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7182c374-f829-4925-8e74-111b936716b9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:09.335329 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7182c374-f829-4925-8e74-111b936716b9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:09.335939 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7182c374-f829-4925-8e74-111b936716b9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:09.336475 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7182c374-f829-4925-8e74-111b936716b9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:09.343277 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7182c374-f829-4925-8e74-111b936716b9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:09.547193 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d7d09888-25a7-4db2-9eb7-b1a2a58f2e58 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:09.559786 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d7d09888-25a7-4db2-9eb7-b1a2a58f2e58 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.326357 Jun 02 13:39:09.561276 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 207/423] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:09 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:09.585522 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7182c374-f829-4925-8e74-111b936716b9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:09.593316 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7182c374-f829-4925-8e74-111b936716b9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.273585 Jun 02 13:39:09.593876 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 217/424] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:09 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:09.778951 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b3bb127f-b2a2-4a10-acff-9ce59867789f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:09.779502 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b3bb127f-b2a2-4a10-acff-9ce59867789f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:09.786107 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3bb127f-b2a2-4a10-acff-9ce59867789f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:09.786563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3bb127f-b2a2-4a10-acff-9ce59867789f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:09.787328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3bb127f-b2a2-4a10-acff-9ce59867789f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:09.787770 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3bb127f-b2a2-4a10-acff-9ce59867789f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:09.846074 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-564b5108-d32d-419e-a6e4-425693d99397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:09.846683 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-564b5108-d32d-419e-a6e4-425693d99397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:09.853213 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-564b5108-d32d-419e-a6e4-425693d99397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:09.853661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-564b5108-d32d-419e-a6e4-425693d99397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:09.854434 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-564b5108-d32d-419e-a6e4-425693d99397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:09.854870 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-564b5108-d32d-419e-a6e4-425693d99397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:09.977881 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b3bb127f-b2a2-4a10-acff-9ce59867789f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:09.991928 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b3bb127f-b2a2-4a10-acff-9ce59867789f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.216630 Jun 02 13:39:09.993403 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 208/425] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:09 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:10.040375 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-564b5108-d32d-419e-a6e4-425693d99397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:10.042682 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:10.050563 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-564b5108-d32d-419e-a6e4-425693d99397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.207782 Jun 02 13:39:10.051143 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 218/426] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:09 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:10.084194 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0ca760ea-9c89-4e04-ac5a-347c6d7098e6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:10.084961 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0ca760ea-9c89-4e04-ac5a-347c6d7098e6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:10.091955 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ca760ea-9c89-4e04-ac5a-347c6d7098e6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:10.092433 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ca760ea-9c89-4e04-ac5a-347c6d7098e6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:10.093422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ca760ea-9c89-4e04-ac5a-347c6d7098e6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:10.093865 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ca760ea-9c89-4e04-ac5a-347c6d7098e6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:10.243839 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0ca760ea-9c89-4e04-ac5a-347c6d7098e6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:10.252633 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0ca760ea-9c89-4e04-ac5a-347c6d7098e6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:10.254544 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0ca760ea-9c89-4e04-ac5a-347c6d7098e6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:10.259809 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0ca760ea-9c89-4e04-ac5a-347c6d7098e6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.179711 Jun 02 13:39:10.262420 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 209/427] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:10 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:10.577302 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-35ba0a9a-937c-45bf-911c-61f299cafefd tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:10.578190 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-35ba0a9a-937c-45bf-911c-61f299cafefd tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:10.591964 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-35ba0a9a-937c-45bf-911c-61f299cafefd tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:10.593240 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-35ba0a9a-937c-45bf-911c-61f299cafefd tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:10.594477 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-35ba0a9a-937c-45bf-911c-61f299cafefd tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:10.594985 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-35ba0a9a-937c-45bf-911c-61f299cafefd tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:10.612055 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-72b29d2a-3b29-4ab7-b044-7247a83792f1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:10.613553 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-72b29d2a-3b29-4ab7-b044-7247a83792f1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:10.621439 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72b29d2a-3b29-4ab7-b044-7247a83792f1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:10.622236 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72b29d2a-3b29-4ab7-b044-7247a83792f1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:10.623236 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72b29d2a-3b29-4ab7-b044-7247a83792f1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:10.623902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72b29d2a-3b29-4ab7-b044-7247a83792f1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:10.901929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-35ba0a9a-937c-45bf-911c-61f299cafefd tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:10.905599 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-72b29d2a-3b29-4ab7-b044-7247a83792f1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:10.913319 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-35ba0a9a-937c-45bf-911c-61f299cafefd tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.339720 Jun 02 13:39:10.913911 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 219/428] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:10 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:10.915078 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-72b29d2a-3b29-4ab7-b044-7247a83792f1 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.306904 Jun 02 13:39:10.915927 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 210/429] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:10 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:11.020586 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-49d61a93-50aa-4ec6-91d6-8a55fbb830bf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:11.021842 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-49d61a93-50aa-4ec6-91d6-8a55fbb830bf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:11.027898 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49d61a93-50aa-4ec6-91d6-8a55fbb830bf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:11.028394 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49d61a93-50aa-4ec6-91d6-8a55fbb830bf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:11.029177 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49d61a93-50aa-4ec6-91d6-8a55fbb830bf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:11.029629 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49d61a93-50aa-4ec6-91d6-8a55fbb830bf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:11.068932 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3b067289-52f5-4825-9ade-f94b2c3f7c8e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:11.069661 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3b067289-52f5-4825-9ade-f94b2c3f7c8e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:11.076236 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3b067289-52f5-4825-9ade-f94b2c3f7c8e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:11.076812 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3b067289-52f5-4825-9ade-f94b2c3f7c8e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:11.077671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3b067289-52f5-4825-9ade-f94b2c3f7c8e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:11.078195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3b067289-52f5-4825-9ade-f94b2c3f7c8e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:11.254977 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-49d61a93-50aa-4ec6-91d6-8a55fbb830bf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:11.264749 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-49d61a93-50aa-4ec6-91d6-8a55fbb830bf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.248588 Jun 02 13:39:11.265521 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 220/430] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:11 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:11.267703 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3b067289-52f5-4825-9ade-f94b2c3f7c8e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:11.279953 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a6b87232-9637-4fec-89c8-1b97ccc53c03 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:11.280786 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a6b87232-9637-4fec-89c8-1b97ccc53c03 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:11.282961 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3b067289-52f5-4825-9ade-f94b2c3f7c8e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.217906 Jun 02 13:39:11.283543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 211/431] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:11 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:11.287406 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a6b87232-9637-4fec-89c8-1b97ccc53c03 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:11.287982 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a6b87232-9637-4fec-89c8-1b97ccc53c03 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:11.288910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a6b87232-9637-4fec-89c8-1b97ccc53c03 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:11.289464 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a6b87232-9637-4fec-89c8-1b97ccc53c03 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:11.432278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a6b87232-9637-4fec-89c8-1b97ccc53c03 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:11.441108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a6b87232-9637-4fec-89c8-1b97ccc53c03 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:11.442913 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a6b87232-9637-4fec-89c8-1b97ccc53c03 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:11.444179 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a6b87232-9637-4fec-89c8-1b97ccc53c03 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.168003 Jun 02 13:39:11.445501 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 221/432] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:11 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:39:11.934465 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e405c5fe-bc6d-4d05-99d0-0697b10f7463 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:11.936824 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a3308d52-b659-47b8-a284-5a6e24000b98 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:11.938017 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e405c5fe-bc6d-4d05-99d0-0697b10f7463 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:11.942083 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a3308d52-b659-47b8-a284-5a6e24000b98 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:11.950660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a3308d52-b659-47b8-a284-5a6e24000b98 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:11.951117 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a3308d52-b659-47b8-a284-5a6e24000b98 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:11.951901 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a3308d52-b659-47b8-a284-5a6e24000b98 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:11.952363 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a3308d52-b659-47b8-a284-5a6e24000b98 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:11.954412 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e405c5fe-bc6d-4d05-99d0-0697b10f7463 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:11.955052 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e405c5fe-bc6d-4d05-99d0-0697b10f7463 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:11.955999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e405c5fe-bc6d-4d05-99d0-0697b10f7463 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:11.956648 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e405c5fe-bc6d-4d05-99d0-0697b10f7463 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:12.183157 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e405c5fe-bc6d-4d05-99d0-0697b10f7463 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:12.192149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e405c5fe-bc6d-4d05-99d0-0697b10f7463 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.261322 Jun 02 13:39:12.195875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 222/433] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:11 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:12.203135 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a3308d52-b659-47b8-a284-5a6e24000b98 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:12.214349 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a3308d52-b659-47b8-a284-5a6e24000b98 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.287222 Jun 02 13:39:12.224671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 212/434] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:11 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:12.283220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-15ddffc4-ef18-42c7-8607-83e6d97861b7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:12.284127 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-15ddffc4-ef18-42c7-8607-83e6d97861b7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:12.292341 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-15ddffc4-ef18-42c7-8607-83e6d97861b7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:12.293517 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-15ddffc4-ef18-42c7-8607-83e6d97861b7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:12.300709 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0f8155d6-ecff-4ef1-82ed-8c95b8992f71 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:12.301534 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0f8155d6-ecff-4ef1-82ed-8c95b8992f71 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:12.306434 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-15ddffc4-ef18-42c7-8607-83e6d97861b7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:12.307328 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-15ddffc4-ef18-42c7-8607-83e6d97861b7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:12.313679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f8155d6-ecff-4ef1-82ed-8c95b8992f71 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:12.314351 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f8155d6-ecff-4ef1-82ed-8c95b8992f71 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:12.315375 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f8155d6-ecff-4ef1-82ed-8c95b8992f71 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:12.317177 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f8155d6-ecff-4ef1-82ed-8c95b8992f71 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:12.543974 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-15ddffc4-ef18-42c7-8607-83e6d97861b7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:12.551642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0f8155d6-ecff-4ef1-82ed-8c95b8992f71 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:12.558930 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-15ddffc4-ef18-42c7-8607-83e6d97861b7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.279915 Jun 02 13:39:12.560438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0f8155d6-ecff-4ef1-82ed-8c95b8992f71 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.264466 Jun 02 13:39:12.561484 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 223/436] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:12 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:12.561673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 213/436] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:12 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:12.571097 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-56a497ad-f153-4f8f-a850-3bdd0e0026e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:12.571097 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-56a497ad-f153-4f8f-a850-3bdd0e0026e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:12.573931 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-56a497ad-f153-4f8f-a850-3bdd0e0026e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:12.574593 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-56a497ad-f153-4f8f-a850-3bdd0e0026e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:12.575524 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-56a497ad-f153-4f8f-a850-3bdd0e0026e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:12.576195 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-56a497ad-f153-4f8f-a850-3bdd0e0026e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:12.739200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-56a497ad-f153-4f8f-a850-3bdd0e0026e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:12.747846 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-56a497ad-f153-4f8f-a850-3bdd0e0026e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:12.749398 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-56a497ad-f153-4f8f-a850-3bdd0e0026e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:12.751288 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-56a497ad-f153-4f8f-a850-3bdd0e0026e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.188191 Jun 02 13:39:12.751425 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 224/437] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:12 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:13.216177 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1ef02b02-bc44-4d61-b91e-e5bc8de58518 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:13.216986 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1ef02b02-bc44-4d61-b91e-e5bc8de58518 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:13.230931 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-160b6612-d018-4ccd-8736-986d90b29ea2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:13.231836 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-160b6612-d018-4ccd-8736-986d90b29ea2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:13.234385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:13.244594 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ef02b02-bc44-4d61-b91e-e5bc8de58518 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:13.245511 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ef02b02-bc44-4d61-b91e-e5bc8de58518 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:13.246411 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ef02b02-bc44-4d61-b91e-e5bc8de58518 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:13.247021 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ef02b02-bc44-4d61-b91e-e5bc8de58518 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:13.251585 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-160b6612-d018-4ccd-8736-986d90b29ea2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:13.252627 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-160b6612-d018-4ccd-8736-986d90b29ea2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:13.253965 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-160b6612-d018-4ccd-8736-986d90b29ea2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:13.254643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-160b6612-d018-4ccd-8736-986d90b29ea2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:13.685144 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-160b6612-d018-4ccd-8736-986d90b29ea2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:13.694795 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-160b6612-d018-4ccd-8736-986d90b29ea2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.467692 Jun 02 13:39:13.695390 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 225/438] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:13 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:13.704772 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-86fd0c72-38e7-4047-b0e2-64072b97a4dc req-533e5d66-eaf5-44a2-9158-d284edfe34be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8851d9-9e33-4d8f-b120-f3b71a4f44a0", "tag": "331888dc-5e0f-4a52-be55-4b6a38503c9d"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:13.724283 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-86fd0c72-38e7-4047-b0e2-64072b97a4dc req-533e5d66-eaf5-44a2-9158-d284edfe34be service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:13.724755 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-86fd0c72-38e7-4047-b0e2-64072b97a4dc req-533e5d66-eaf5-44a2-9158-d284edfe34be service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:13.778840 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-86fd0c72-38e7-4047-b0e2-64072b97a4dc req-533e5d66-eaf5-44a2-9158-d284edfe34be service nova] Creating event network-changed:331888dc-5e0f-4a52-be55-4b6a38503c9d for instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 on hv-cinder-83608 Jun 02 13:39:13.788432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1ef02b02-bc44-4d61-b91e-e5bc8de58518 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:13.795380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-86fd0c72-38e7-4047-b0e2-64072b97a4dc req-533e5d66-eaf5-44a2-9158-d284edfe34be service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098763 Jun 02 13:39:13.796589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 226/439] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:13.805347 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1ef02b02-bc44-4d61-b91e-e5bc8de58518 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1359 microversion: 2.1 time: 0.596175 Jun 02 13:39:13.806033 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f9775e9c-1ec5-4496-95f2-891d83ff5578 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:13.806914 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f9775e9c-1ec5-4496-95f2-891d83ff5578 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:13.809275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:13.816697 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9775e9c-1ec5-4496-95f2-891d83ff5578 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:13.817082 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 214/440] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:13 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1359 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:13.817463 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9775e9c-1ec5-4496-95f2-891d83ff5578 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:13.819299 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9775e9c-1ec5-4496-95f2-891d83ff5578 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:13.819761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9775e9c-1ec5-4496-95f2-891d83ff5578 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:13.823151 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-991cfedb-1bfe-4745-97a5-a41c838ad6f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:13.824105 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-991cfedb-1bfe-4745-97a5-a41c838ad6f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:13.831760 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-991cfedb-1bfe-4745-97a5-a41c838ad6f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:13.832229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-991cfedb-1bfe-4745-97a5-a41c838ad6f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:13.833051 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-991cfedb-1bfe-4745-97a5-a41c838ad6f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:13.833491 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-991cfedb-1bfe-4745-97a5-a41c838ad6f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:13.839553 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=6 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:14.124481 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f9775e9c-1ec5-4496-95f2-891d83ff5578 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:14.133503 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f9775e9c-1ec5-4496-95f2-891d83ff5578 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.332495 Jun 02 13:39:14.134420 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-991cfedb-1bfe-4745-97a5-a41c838ad6f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:14.137756 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:14.144374 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 227/441] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:13 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:14.152065 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5a20a936-4de2-4d05-a684-75e57015ce63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:14.152703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5a20a936-4de2-4d05-a684-75e57015ce63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:14.158879 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-991cfedb-1bfe-4745-97a5-a41c838ad6f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.336373 Jun 02 13:39:14.161664 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a20a936-4de2-4d05-a684-75e57015ce63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:14.161664 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a20a936-4de2-4d05-a684-75e57015ce63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:14.162245 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a20a936-4de2-4d05-a684-75e57015ce63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:14.162714 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a20a936-4de2-4d05-a684-75e57015ce63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:14.163448 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 215/442] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:13 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:14.169469 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1632028953", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-346117521", "security_groups": [{"name": "tempest-secgroup-smoke-2079020983"}], "networks": [{"uuid": "8e0a3ac5-6872-4090-862a-74bb144ed3e5"}], "block_device_mapping_v2": [{"uuid": "edc3ad51-4f35-4129-8cb3-a89f0f822f9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:14.331603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=6 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:14.459164 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5a20a936-4de2-4d05-a684-75e57015ce63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:14.544150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5a20a936-4de2-4d05-a684-75e57015ce63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:14.546127 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5a20a936-4de2-4d05-a684-75e57015ce63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:14.551527 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5a20a936-4de2-4d05-a684-75e57015ce63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.406002 Jun 02 13:39:14.552239 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 228/443] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:14 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:14.609645 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] validate_networks() for [('8e0a3ac5-6872-4090-862a-74bb144ed3e5', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:39:14.713092 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ec6c74eb-5e93-4415-9a47-aa9f7a8e3235 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:14.713787 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ec6c74eb-5e93-4415-9a47-aa9f7a8e3235 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:14.724035 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec6c74eb-5e93-4415-9a47-aa9f7a8e3235 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:14.727992 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec6c74eb-5e93-4415-9a47-aa9f7a8e3235 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:14.729118 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec6c74eb-5e93-4415-9a47-aa9f7a8e3235 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:14.729787 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec6c74eb-5e93-4415-9a47-aa9f7a8e3235 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:15.278840 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ec6c74eb-5e93-4415-9a47-aa9f7a8e3235 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:15.291482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ec6c74eb-5e93-4415-9a47-aa9f7a8e3235 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.582188 Jun 02 13:39:15.308663 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 229/444] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:14 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:15.314394 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-90c960db-0ec8-4811-9c00-c785a4368f01 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:15.315274 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-90c960db-0ec8-4811-9c00-c785a4368f01 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:15.322836 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90c960db-0ec8-4811-9c00-c785a4368f01 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:15.323553 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90c960db-0ec8-4811-9c00-c785a4368f01 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:15.324542 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90c960db-0ec8-4811-9c00-c785a4368f01 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:15.325189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90c960db-0ec8-4811-9c00-c785a4368f01 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:15.728747 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-90c960db-0ec8-4811-9c00-c785a4368f01 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:15.742174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-90c960db-0ec8-4811-9c00-c785a4368f01 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1548 microversion: 2.1 time: 0.431570 Jun 02 13:39:15.749212 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 230/445] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:15 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1548 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:15.762947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:39:15.764255 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-db39e5cf-0cef-4e10-a2ac-392de91dbeab req-129485ef-209a-486a-8cde-fe4c087a7ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec", "name": "network-vif-plugged", "status": "completed", "tag": "94186e6c-fc85-41ca-ae77-bd755f5fceed"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:15.765114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:39:15.766436 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:39:15.767638 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:39:15.768606 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:39:15.777789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-db39e5cf-0cef-4e10-a2ac-392de91dbeab req-129485ef-209a-486a-8cde-fe4c087a7ff2 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:15.778249 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-db39e5cf-0cef-4e10-a2ac-392de91dbeab req-129485ef-209a-486a-8cde-fe4c087a7ff2 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:15.796151 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:15.796852 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:15.797803 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:15.798360 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:15.809488 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-db39e5cf-0cef-4e10-a2ac-392de91dbeab req-129485ef-209a-486a-8cde-fe4c087a7ff2 service nova] Creating event network-vif-plugged:94186e6c-fc85-41ca-ae77-bd755f5fceed for instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec on hv-cinder-83608 Jun 02 13:39:15.818226 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-db39e5cf-0cef-4e10-a2ac-392de91dbeab req-129485ef-209a-486a-8cde-fe4c087a7ff2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066970 Jun 02 13:39:15.821544 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 231/446] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:15.833274 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-754213db-8bb2-449d-93ae-447d49148df5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:15.838105 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-754213db-8bb2-449d-93ae-447d49148df5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:15.849096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-754213db-8bb2-449d-93ae-447d49148df5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:15.852026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-754213db-8bb2-449d-93ae-447d49148df5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:15.854208 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-754213db-8bb2-449d-93ae-447d49148df5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:15.856152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-754213db-8bb2-449d-93ae-447d49148df5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:15.856839 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Getting quotas for project ba31334d858a4e698ac0f8fc2e846895. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:39:15.864897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Getting quotas for user 02eb6e337f9a4bf5992b8668a6f0fa3a and project ba31334d858a4e698ac0f8fc2e846895. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:39:15.973380 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:39:15.975657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edc3ad51-4f35-4129-8cb3-a89f0f822f9e',volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:39:16.096441 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-754213db-8bb2-449d-93ae-447d49148df5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:16.108384 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-754213db-8bb2-449d-93ae-447d49148df5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.284643 Jun 02 13:39:16.109537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 232/447] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:15 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:16.114750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cdd482cb-9321-4253-8361-81a09fbb5661 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:16.115593 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cdd482cb-9321-4253-8361-81a09fbb5661 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:16.122460 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cdd482cb-9321-4253-8361-81a09fbb5661 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.123061 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cdd482cb-9321-4253-8361-81a09fbb5661 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.124183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cdd482cb-9321-4253-8361-81a09fbb5661 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.124601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cdd482cb-9321-4253-8361-81a09fbb5661 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.279753 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-82b6d020-4cd7-48c6-a5d0-651d19ed7099 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.112631 Jun 02 13:39:16.281247 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 216/448] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:39:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:39:16.312759 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3c1760f4-7ee2-4341-9475-97e51839bddd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:16.313626 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3c1760f4-7ee2-4341-9475-97e51839bddd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:16.320259 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cdd482cb-9321-4253-8361-81a09fbb5661 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:16.321357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c1760f4-7ee2-4341-9475-97e51839bddd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.322966 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c1760f4-7ee2-4341-9475-97e51839bddd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.324206 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c1760f4-7ee2-4341-9475-97e51839bddd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.324771 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c1760f4-7ee2-4341-9475-97e51839bddd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.341924 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cdd482cb-9321-4253-8361-81a09fbb5661 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.231053 Jun 02 13:39:16.353621 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 233/449] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:16 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:16.358462 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-838972c8-8d3a-4694-915d-b852a32f0180 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:16.360056 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-838972c8-8d3a-4694-915d-b852a32f0180 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:16.367764 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-838972c8-8d3a-4694-915d-b852a32f0180 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.368490 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-838972c8-8d3a-4694-915d-b852a32f0180 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.369442 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-838972c8-8d3a-4694-915d-b852a32f0180 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.370044 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-838972c8-8d3a-4694-915d-b852a32f0180 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.581714 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-838972c8-8d3a-4694-915d-b852a32f0180 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:16.591318 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-838972c8-8d3a-4694-915d-b852a32f0180 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1548 microversion: 2.1 time: 0.236450 Jun 02 13:39:16.595085 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 234/450] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:16 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1548 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:16.600755 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-10c64a35-f7f1-4972-a511-0dcad55bc93a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:16.601664 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-10c64a35-f7f1-4972-a511-0dcad55bc93a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:16.606835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3c1760f4-7ee2-4341-9475-97e51839bddd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:16.618816 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3c1760f4-7ee2-4341-9475-97e51839bddd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:16.621242 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3c1760f4-7ee2-4341-9475-97e51839bddd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:16.622800 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3c1760f4-7ee2-4341-9475-97e51839bddd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.331267 Jun 02 13:39:16.623606 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 217/451] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:16 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:16.629581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e7c8cc30-61c8-48ec-9039-9fa7c170ff24 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:16.630380 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e7c8cc30-61c8-48ec-9039-9fa7c170ff24 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:16.636880 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7c8cc30-61c8-48ec-9039-9fa7c170ff24 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.637537 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7c8cc30-61c8-48ec-9039-9fa7c170ff24 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.648644 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7c8cc30-61c8-48ec-9039-9fa7c170ff24 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.650477 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7c8cc30-61c8-48ec-9039-9fa7c170ff24 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.675534 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-10c64a35-f7f1-4972-a511-0dcad55bc93a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:16.682826 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-10c64a35-f7f1-4972-a511-0dcad55bc93a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1088 microversion: 2.1 time: 0.085987 Jun 02 13:39:16.685008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 235/452] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:16 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1088 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:16.698191 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4e0a078b-98c9-48d5-a72e-7cbb68256d04 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:16.702326 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4e0a078b-98c9-48d5-a72e-7cbb68256d04 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:16.703380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4e0a078b-98c9-48d5-a72e-7cbb68256d04 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Searching by: {'deleted': False, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc'} {{(pid=124123) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 02 13:39:16.713365 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e0a078b-98c9-48d5-a72e-7cbb68256d04 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.714051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e0a078b-98c9-48d5-a72e-7cbb68256d04 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.715069 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e0a078b-98c9-48d5-a72e-7cbb68256d04 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.715689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e0a078b-98c9-48d5-a72e-7cbb68256d04 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.827727 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.multi_cell_list [None req-4e0a078b-98c9-48d5-a72e-7cbb68256d04 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 02 13:39:16.835392 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e7c8cc30-61c8-48ec-9039-9fa7c170ff24 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:16.843444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e7c8cc30-61c8-48ec-9039-9fa7c170ff24 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.218392 Jun 02 13:39:16.844022 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 218/453] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:16 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:16.939205 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4e0a078b-98c9-48d5-a72e-7cbb68256d04 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.252699 Jun 02 13:39:16.940837 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 236/454] 10.222.0.32 () {58 vars in 1124 bytes} [Thu Jun 2 13:39:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:16.950973 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4b0405e7-83fe-4526-a17f-3fc2a3554f26 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:16.951834 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4b0405e7-83fe-4526-a17f-3fc2a3554f26 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:16.959098 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b0405e7-83fe-4526-a17f-3fc2a3554f26 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.959840 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b0405e7-83fe-4526-a17f-3fc2a3554f26 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:16.960650 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b0405e7-83fe-4526-a17f-3fc2a3554f26 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:16.961260 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b0405e7-83fe-4526-a17f-3fc2a3554f26 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:17.106012 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4b0405e7-83fe-4526-a17f-3fc2a3554f26 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:17.114489 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4b0405e7-83fe-4526-a17f-3fc2a3554f26 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1548 microversion: 2.1 time: 0.167505 Jun 02 13:39:17.126406 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-45471f26-0298-45bb-8ee5-bdbfc9360a59 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:17.128419 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-45471f26-0298-45bb-8ee5-bdbfc9360a59 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:17.135837 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45471f26-0298-45bb-8ee5-bdbfc9360a59 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:17.136036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 219/455] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:16 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:17.136535 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45471f26-0298-45bb-8ee5-bdbfc9360a59 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:17.137588 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45471f26-0298-45bb-8ee5-bdbfc9360a59 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:17.138117 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45471f26-0298-45bb-8ee5-bdbfc9360a59 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:17.155905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:17.285820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-45471f26-0298-45bb-8ee5-bdbfc9360a59 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:17.293379 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-45471f26-0298-45bb-8ee5-bdbfc9360a59 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.170906 Jun 02 13:39:17.295576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 237/456] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:17 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:17.361548 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-93527873-a8db-40f0-b992-a5ccffd7a349 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:17.362524 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-93527873-a8db-40f0-b992-a5ccffd7a349 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:17.369434 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93527873-a8db-40f0-b992-a5ccffd7a349 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:17.370217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93527873-a8db-40f0-b992-a5ccffd7a349 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:17.371280 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93527873-a8db-40f0-b992-a5ccffd7a349 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:17.371882 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93527873-a8db-40f0-b992-a5ccffd7a349 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:17.653561 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0458e69a-a5b4-4c23-873b-048a6d576173 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:17.656599 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0458e69a-a5b4-4c23-873b-048a6d576173 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:17.683445 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0458e69a-a5b4-4c23-873b-048a6d576173 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:17.683933 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0458e69a-a5b4-4c23-873b-048a6d576173 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:17.687805 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0458e69a-a5b4-4c23-873b-048a6d576173 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:17.688272 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0458e69a-a5b4-4c23-873b-048a6d576173 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:17.849957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-93527873-a8db-40f0-b992-a5ccffd7a349 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:17.858089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-93527873-a8db-40f0-b992-a5ccffd7a349 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.501010 Jun 02 13:39:17.858654 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 220/457] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:17 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:17.863626 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-43d53dfe-e0c8-446e-9156-ae40783a1553 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:17.864229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-43d53dfe-e0c8-446e-9156-ae40783a1553 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:17.870060 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-43d53dfe-e0c8-446e-9156-ae40783a1553 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:17.870512 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-43d53dfe-e0c8-446e-9156-ae40783a1553 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:17.871266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-43d53dfe-e0c8-446e-9156-ae40783a1553 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:17.871697 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-43d53dfe-e0c8-446e-9156-ae40783a1553 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:17.920331 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0458e69a-a5b4-4c23-873b-048a6d576173 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:17.928961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0458e69a-a5b4-4c23-873b-048a6d576173 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:17.930461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0458e69a-a5b4-4c23-873b-048a6d576173 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:17.931605 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0458e69a-a5b4-4c23-873b-048a6d576173 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1740 microversion: 2.20 time: 0.292306 Jun 02 13:39:17.932155 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 238/458] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:17 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:17.936742 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-43d53dfe-e0c8-446e-9156-ae40783a1553 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:17.936905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-90e1c7d1-b28e-4707-b8c9-6ceacbf0b249 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:17.937471 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-90e1c7d1-b28e-4707-b8c9-6ceacbf0b249 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:17.943592 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90e1c7d1-b28e-4707-b8c9-6ceacbf0b249 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:17.944053 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90e1c7d1-b28e-4707-b8c9-6ceacbf0b249 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:17.944574 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-43d53dfe-e0c8-446e-9156-ae40783a1553 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1130 microversion: 2.1 time: 0.084941 Jun 02 13:39:17.944875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90e1c7d1-b28e-4707-b8c9-6ceacbf0b249 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:17.945145 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 221/459] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:17 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1130 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:17.945335 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-90e1c7d1-b28e-4707-b8c9-6ceacbf0b249 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:18.312396 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8594f261-4b43-4d43-9413-5ffa7f552adb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:18.317043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8594f261-4b43-4d43-9413-5ffa7f552adb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:18.326013 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8594f261-4b43-4d43-9413-5ffa7f552adb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:18.326465 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8594f261-4b43-4d43-9413-5ffa7f552adb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:18.327253 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8594f261-4b43-4d43-9413-5ffa7f552adb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:18.327696 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8594f261-4b43-4d43-9413-5ffa7f552adb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:18.477361 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-90e1c7d1-b28e-4707-b8c9-6ceacbf0b249 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:18.485293 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-90e1c7d1-b28e-4707-b8c9-6ceacbf0b249 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.551782 Jun 02 13:39:18.495347 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 239/460] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:17 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:18.517986 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8594f261-4b43-4d43-9413-5ffa7f552adb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:18.527263 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8594f261-4b43-4d43-9413-5ffa7f552adb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.219621 Jun 02 13:39:18.527877 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 222/461] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:18 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:18.877004 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ee442749-a41e-4a57-a36b-e85147993792 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:18.878464 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ee442749-a41e-4a57-a36b-e85147993792 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:18.891896 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ee442749-a41e-4a57-a36b-e85147993792 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:18.893385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ee442749-a41e-4a57-a36b-e85147993792 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:18.894938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ee442749-a41e-4a57-a36b-e85147993792 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:18.896845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ee442749-a41e-4a57-a36b-e85147993792 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:18.916576 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-725f9a83-2937-4e50-a91e-2c3b4158ad59 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd472988-c457-4d6f-8c03-3a6065473483"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:18.918604 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-725f9a83-2937-4e50-a91e-2c3b4158ad59 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:18.932736 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-725f9a83-2937-4e50-a91e-2c3b4158ad59 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:18.933623 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-725f9a83-2937-4e50-a91e-2c3b4158ad59 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:18.934760 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-725f9a83-2937-4e50-a91e-2c3b4158ad59 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:18.935366 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-725f9a83-2937-4e50-a91e-2c3b4158ad59 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:19.095437 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ee442749-a41e-4a57-a36b-e85147993792 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:19.105050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ee442749-a41e-4a57-a36b-e85147993792 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.233098 Jun 02 13:39:19.106399 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 240/462] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:18 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:19.124389 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7bc225e1-3883-4724-a38e-e397cc2cf41b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:19.125486 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7bc225e1-3883-4724-a38e-e397cc2cf41b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:19.136180 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7bc225e1-3883-4724-a38e-e397cc2cf41b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:19.136794 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7bc225e1-3883-4724-a38e-e397cc2cf41b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:19.138364 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7bc225e1-3883-4724-a38e-e397cc2cf41b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:19.138880 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7bc225e1-3883-4724-a38e-e397cc2cf41b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:19.289386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7bc225e1-3883-4724-a38e-e397cc2cf41b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:19.300639 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7bc225e1-3883-4724-a38e-e397cc2cf41b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:19.303406 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7bc225e1-3883-4724-a38e-e397cc2cf41b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:19.305001 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7bc225e1-3883-4724-a38e-e397cc2cf41b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1722 microversion: 2.20 time: 0.196855 Jun 02 13:39:19.306491 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 241/463] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:19 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:19.314170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6f5a1b16-2d67-4d08-a577-a8d2e4c952a0 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:19.314994 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6f5a1b16-2d67-4d08-a577-a8d2e4c952a0 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:19.322796 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f5a1b16-2d67-4d08-a577-a8d2e4c952a0 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:19.323614 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f5a1b16-2d67-4d08-a577-a8d2e4c952a0 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:19.324800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f5a1b16-2d67-4d08-a577-a8d2e4c952a0 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:19.325587 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f5a1b16-2d67-4d08-a577-a8d2e4c952a0 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:19.409460 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6f5a1b16-2d67-4d08-a577-a8d2e4c952a0 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:19.424698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6f5a1b16-2d67-4d08-a577-a8d2e4c952a0 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1130 microversion: 2.1 time: 0.116356 Jun 02 13:39:19.426229 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 242/464] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:19 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1130 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:19.501987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-99325c8e-b1c1-4056-837d-e4b10bfaab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:19.502708 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-99325c8e-b1c1-4056-837d-e4b10bfaab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:19.509121 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-99325c8e-b1c1-4056-837d-e4b10bfaab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:19.509693 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-99325c8e-b1c1-4056-837d-e4b10bfaab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:19.510596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-99325c8e-b1c1-4056-837d-e4b10bfaab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:19.511125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-99325c8e-b1c1-4056-837d-e4b10bfaab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:19.698785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-99325c8e-b1c1-4056-837d-e4b10bfaab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:19.707052 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-99325c8e-b1c1-4056-837d-e4b10bfaab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.208905 Jun 02 13:39:19.708562 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 243/465] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:19 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:19.714094 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d6177350-5b1c-4a04-9345-d1006f80ffe6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:19.714938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d6177350-5b1c-4a04-9345-d1006f80ffe6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:19.722321 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6177350-5b1c-4a04-9345-d1006f80ffe6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:19.722777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6177350-5b1c-4a04-9345-d1006f80ffe6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:19.723908 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6177350-5b1c-4a04-9345-d1006f80ffe6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:19.724387 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6177350-5b1c-4a04-9345-d1006f80ffe6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:19.889302 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d6177350-5b1c-4a04-9345-d1006f80ffe6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:19.900092 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d6177350-5b1c-4a04-9345-d1006f80ffe6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1365 microversion: 2.1 time: 0.190244 Jun 02 13:39:19.900896 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 244/466] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:19 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:20.125544 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8761b0d3-7d51-4d81-a08e-251f5b44c610 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:20.127044 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8761b0d3-7d51-4d81-a08e-251f5b44c610 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:20.137087 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8761b0d3-7d51-4d81-a08e-251f5b44c610 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:20.138290 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8761b0d3-7d51-4d81-a08e-251f5b44c610 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:20.140027 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8761b0d3-7d51-4d81-a08e-251f5b44c610 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:20.141380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8761b0d3-7d51-4d81-a08e-251f5b44c610 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:20.332465 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8761b0d3-7d51-4d81-a08e-251f5b44c610 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:20.344505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8761b0d3-7d51-4d81-a08e-251f5b44c610 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.222804 Jun 02 13:39:20.346003 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 245/467] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:20 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:20.355471 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f5c45989-d337-407e-8ffa-5cc90b67f459 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:20.356647 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f5c45989-d337-407e-8ffa-5cc90b67f459 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:20.369426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f5c45989-d337-407e-8ffa-5cc90b67f459 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:20.369985 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f5c45989-d337-407e-8ffa-5cc90b67f459 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:20.371421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f5c45989-d337-407e-8ffa-5cc90b67f459 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:20.372222 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f5c45989-d337-407e-8ffa-5cc90b67f459 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:20.537217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f5c45989-d337-407e-8ffa-5cc90b67f459 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:20.546843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f5c45989-d337-407e-8ffa-5cc90b67f459 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:20.548635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f5c45989-d337-407e-8ffa-5cc90b67f459 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:20.550542 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f5c45989-d337-407e-8ffa-5cc90b67f459 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1722 microversion: 2.20 time: 0.203166 Jun 02 13:39:20.551422 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 246/468] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:20 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:20.564153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-55b4c200-e7bf-4db7-8ef3-404031bbd56c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:20.564788 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-55b4c200-e7bf-4db7-8ef3-404031bbd56c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:20.573720 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-55b4c200-e7bf-4db7-8ef3-404031bbd56c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:20.574175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-55b4c200-e7bf-4db7-8ef3-404031bbd56c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:20.574955 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-55b4c200-e7bf-4db7-8ef3-404031bbd56c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:20.575559 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-55b4c200-e7bf-4db7-8ef3-404031bbd56c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:20.643960 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-55b4c200-e7bf-4db7-8ef3-404031bbd56c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:20.653286 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-55b4c200-e7bf-4db7-8ef3-404031bbd56c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1186 microversion: 2.1 time: 0.100678 Jun 02 13:39:20.654133 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 247/469] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:20 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:20.726522 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d41f18b7-704f-433d-b546-604398eb9d32 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:20.727179 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d41f18b7-704f-433d-b546-604398eb9d32 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:20.734491 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d41f18b7-704f-433d-b546-604398eb9d32 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:20.735392 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d41f18b7-704f-433d-b546-604398eb9d32 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:20.736394 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d41f18b7-704f-433d-b546-604398eb9d32 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:20.737699 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d41f18b7-704f-433d-b546-604398eb9d32 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:20.938927 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d41f18b7-704f-433d-b546-604398eb9d32 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:20.953225 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d41f18b7-704f-433d-b546-604398eb9d32 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.231501 Jun 02 13:39:20.957200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 248/470] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:20 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:20.964799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2f921294-30f7-4aee-abe9-e0e577c98efe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:20.965780 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2f921294-30f7-4aee-abe9-e0e577c98efe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:20.973027 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f921294-30f7-4aee-abe9-e0e577c98efe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:20.973501 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f921294-30f7-4aee-abe9-e0e577c98efe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:20.974275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f921294-30f7-4aee-abe9-e0e577c98efe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:20.974752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f921294-30f7-4aee-abe9-e0e577c98efe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:21.272354 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2f921294-30f7-4aee-abe9-e0e577c98efe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:21.281714 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2f921294-30f7-4aee-abe9-e0e577c98efe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1555 microversion: 2.1 time: 0.322910 Jun 02 13:39:21.281929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 249/471] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:20 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1555 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:21.304528 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f9dd6cb7-1bb1-45bc-a2c9-6ba5a2836d8c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:21.304970 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f9dd6cb7-1bb1-45bc-a2c9-6ba5a2836d8c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:21.327767 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9dd6cb7-1bb1-45bc-a2c9-6ba5a2836d8c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:21.328239 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9dd6cb7-1bb1-45bc-a2c9-6ba5a2836d8c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:21.351603 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9dd6cb7-1bb1-45bc-a2c9-6ba5a2836d8c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:21.353889 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9dd6cb7-1bb1-45bc-a2c9-6ba5a2836d8c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:21.427134 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-725f9a83-2937-4e50-a91e-2c3b4158ad59 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "POST /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.515939 Jun 02 13:39:21.434484 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 223/472] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:39:18 2022] POST /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments => generated 194 bytes in 2525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:39:21.457872 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3a95eb8c-aded-43c9-9f16-65046692d5e2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:21.460865 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3a95eb8c-aded-43c9-9f16-65046692d5e2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:21.484964 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a95eb8c-aded-43c9-9f16-65046692d5e2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:21.497769 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a95eb8c-aded-43c9-9f16-65046692d5e2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:21.499199 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a95eb8c-aded-43c9-9f16-65046692d5e2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:21.500061 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a95eb8c-aded-43c9-9f16-65046692d5e2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:21.716285 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f9dd6cb7-1bb1-45bc-a2c9-6ba5a2836d8c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.416266 Jun 02 13:39:21.717382 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 250/473] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Jun 2 13:39:21 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec/os-interface => generated 284 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:21.725512 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2cdad813-952a-4b7e-ac6d-e9f9cf3595eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:21.726327 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2cdad813-952a-4b7e-ac6d-e9f9cf3595eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:21.745532 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cdad813-952a-4b7e-ac6d-e9f9cf3595eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:21.746213 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cdad813-952a-4b7e-ac6d-e9f9cf3595eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:21.747178 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cdad813-952a-4b7e-ac6d-e9f9cf3595eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:21.747773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cdad813-952a-4b7e-ac6d-e9f9cf3595eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:21.801392 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a95eb8c-aded-43c9-9f16-65046692d5e2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:21.811147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3a95eb8c-aded-43c9-9f16-65046692d5e2 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.375078 Jun 02 13:39:21.814385 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 224/474] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:21 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:21.819520 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b3c2429-a352-47d1-baa8-3c9382a5b352 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:21.820527 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9b3c2429-a352-47d1-baa8-3c9382a5b352 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:21.855659 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b3c2429-a352-47d1-baa8-3c9382a5b352 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:21.858115 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b3c2429-a352-47d1-baa8-3c9382a5b352 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:21.865310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b3c2429-a352-47d1-baa8-3c9382a5b352 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:21.865997 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b3c2429-a352-47d1-baa8-3c9382a5b352 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:22.028144 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9b3c2429-a352-47d1-baa8-3c9382a5b352 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:22.038080 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9b3c2429-a352-47d1-baa8-3c9382a5b352 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1186 microversion: 2.1 time: 0.222330 Jun 02 13:39:22.041171 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 225/475] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:21 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1186 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:22.047506 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-a508504f-033b-41c9-a3f6-516d3e980c0f req-80a0c439-b526-4438-bd45-08a2ad6f1ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8851d9-9e33-4d8f-b120-f3b71a4f44a0", "name": "network-vif-plugged", "status": "completed", "tag": "331888dc-5e0f-4a52-be55-4b6a38503c9d"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:22.070123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2cdad813-952a-4b7e-ac6d-e9f9cf3595eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:22.078885 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-a508504f-033b-41c9-a3f6-516d3e980c0f req-80a0c439-b526-4438-bd45-08a2ad6f1ebf service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:22.079597 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-a508504f-033b-41c9-a3f6-516d3e980c0f req-80a0c439-b526-4438-bd45-08a2ad6f1ebf service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:22.083149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2cdad813-952a-4b7e-ac6d-e9f9cf3595eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:22.086023 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2cdad813-952a-4b7e-ac6d-e9f9cf3595eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:22.089883 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2cdad813-952a-4b7e-ac6d-e9f9cf3595eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1722 microversion: 2.20 time: 0.371132 Jun 02 13:39:22.092231 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 251/476] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:21 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:22.110841 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-01bc0948-79c3-4655-b50f-b1e27d8b905f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:22.117497 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-01bc0948-79c3-4655-b50f-b1e27d8b905f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:22.128986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01bc0948-79c3-4655-b50f-b1e27d8b905f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:22.129619 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-a508504f-033b-41c9-a3f6-516d3e980c0f req-80a0c439-b526-4438-bd45-08a2ad6f1ebf service nova] Creating event network-vif-plugged:331888dc-5e0f-4a52-be55-4b6a38503c9d for instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 on hv-cinder-83608 Jun 02 13:39:22.134362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01bc0948-79c3-4655-b50f-b1e27d8b905f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:22.135761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01bc0948-79c3-4655-b50f-b1e27d8b905f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:22.138393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01bc0948-79c3-4655-b50f-b1e27d8b905f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:22.142552 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-a508504f-033b-41c9-a3f6-516d3e980c0f req-80a0c439-b526-4438-bd45-08a2ad6f1ebf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094954 Jun 02 13:39:22.144740 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 226/477] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:22.304792 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-01bc0948-79c3-4655-b50f-b1e27d8b905f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:22.314306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-01bc0948-79c3-4655-b50f-b1e27d8b905f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.207599 Jun 02 13:39:22.315224 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 252/478] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:22 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:22.830850 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3a3298e6-0754-4b66-ba65-9efa6da996ff tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:22.831576 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3a3298e6-0754-4b66-ba65-9efa6da996ff tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:22.839350 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a3298e6-0754-4b66-ba65-9efa6da996ff tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:22.840446 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a3298e6-0754-4b66-ba65-9efa6da996ff tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:22.841417 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a3298e6-0754-4b66-ba65-9efa6da996ff tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:22.841862 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a3298e6-0754-4b66-ba65-9efa6da996ff tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:23.036694 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a3298e6-0754-4b66-ba65-9efa6da996ff tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:23.045938 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3a3298e6-0754-4b66-ba65-9efa6da996ff tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.219626 Jun 02 13:39:23.046862 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 227/479] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:22 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:23.061905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2c37a2ca-fb01-400c-a279-705a5ffb0e1a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:23.067672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2c37a2ca-fb01-400c-a279-705a5ffb0e1a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:23.082796 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c37a2ca-fb01-400c-a279-705a5ffb0e1a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:23.083560 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c37a2ca-fb01-400c-a279-705a5ffb0e1a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:23.084471 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c37a2ca-fb01-400c-a279-705a5ffb0e1a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:23.084984 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c37a2ca-fb01-400c-a279-705a5ffb0e1a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:23.109813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b80b4f5d-f059-4e69-9911-e299feca366d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:23.110524 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b80b4f5d-f059-4e69-9911-e299feca366d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:23.119227 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b80b4f5d-f059-4e69-9911-e299feca366d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:23.131231 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b80b4f5d-f059-4e69-9911-e299feca366d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:23.132489 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b80b4f5d-f059-4e69-9911-e299feca366d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:23.133165 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b80b4f5d-f059-4e69-9911-e299feca366d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:23.192768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2c37a2ca-fb01-400c-a279-705a5ffb0e1a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:23.206130 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2c37a2ca-fb01-400c-a279-705a5ffb0e1a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1204 microversion: 2.1 time: 0.148237 Jun 02 13:39:23.210177 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 253/480] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:23 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1204 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:23.333824 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b80b4f5d-f059-4e69-9911-e299feca366d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:23.339288 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-febfa91f-fa71-4726-9386-fb2fbe0ea39e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:23.340544 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-febfa91f-fa71-4726-9386-fb2fbe0ea39e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:23.347284 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-febfa91f-fa71-4726-9386-fb2fbe0ea39e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:23.347763 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-febfa91f-fa71-4726-9386-fb2fbe0ea39e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:23.353801 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b80b4f5d-f059-4e69-9911-e299feca366d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:23.356212 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b80b4f5d-f059-4e69-9911-e299feca366d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:23.357935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-febfa91f-fa71-4726-9386-fb2fbe0ea39e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:23.358809 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-febfa91f-fa71-4726-9386-fb2fbe0ea39e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:23.361844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b80b4f5d-f059-4e69-9911-e299feca366d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1722 microversion: 2.20 time: 0.255688 Jun 02 13:39:23.368017 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 228/481] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:23 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:39:23.379340 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:23.481465 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-66cefa0f-d1d5-4a8f-8e6e-19e40195f0b4 req-081eb920-9ad8-40c8-8f5f-499255ff5e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec", "tag": "94186e6c-fc85-41ca-ae77-bd755f5fceed"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:23.497505 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-66cefa0f-d1d5-4a8f-8e6e-19e40195f0b4 req-081eb920-9ad8-40c8-8f5f-499255ff5e2c service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:23.497909 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-66cefa0f-d1d5-4a8f-8e6e-19e40195f0b4 req-081eb920-9ad8-40c8-8f5f-499255ff5e2c service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:23.509991 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-66cefa0f-d1d5-4a8f-8e6e-19e40195f0b4 req-081eb920-9ad8-40c8-8f5f-499255ff5e2c service nova] Creating event network-changed:94186e6c-fc85-41ca-ae77-bd755f5fceed for instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec on hv-cinder-83608 Jun 02 13:39:23.516566 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-66cefa0f-d1d5-4a8f-8e6e-19e40195f0b4 req-081eb920-9ad8-40c8-8f5f-499255ff5e2c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046532 Jun 02 13:39:23.517510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 229/482] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:23.548674 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-febfa91f-fa71-4726-9386-fb2fbe0ea39e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:23.557348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-febfa91f-fa71-4726-9386-fb2fbe0ea39e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.226146 Jun 02 13:39:23.557348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 254/483] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:23 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:24.065742 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c3083d1d-d42d-43d3-ad32-5a1e709b887c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:24.066592 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c3083d1d-d42d-43d3-ad32-5a1e709b887c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:24.073265 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3083d1d-d42d-43d3-ad32-5a1e709b887c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:24.074102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3083d1d-d42d-43d3-ad32-5a1e709b887c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:24.075008 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3083d1d-d42d-43d3-ad32-5a1e709b887c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:24.075662 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3083d1d-d42d-43d3-ad32-5a1e709b887c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:24.162475 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-f77ae694-9713-437b-b4a7-e865dd35ff9d req-e180871d-6096-4585-9a0a-09b1ba29a690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15208f-0bda-407c-8ea0-38a1300bfa16", "name": "network-vif-unplugged", "status": "completed", "tag": "8aab5ca9-b3de-4176-a679-2976edeca505"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:24.178650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-f77ae694-9713-437b-b4a7-e865dd35ff9d req-e180871d-6096-4585-9a0a-09b1ba29a690 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:24.179189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-f77ae694-9713-437b-b4a7-e865dd35ff9d req-e180871d-6096-4585-9a0a-09b1ba29a690 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:24.209790 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-f77ae694-9713-437b-b4a7-e865dd35ff9d req-e180871d-6096-4585-9a0a-09b1ba29a690 service nova] Creating event network-vif-unplugged:8aab5ca9-b3de-4176-a679-2976edeca505 for instance bf15208f-0bda-407c-8ea0-38a1300bfa16 on hv-cinder-83608 Jun 02 13:39:24.215882 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-f77ae694-9713-437b-b4a7-e865dd35ff9d req-e180871d-6096-4585-9a0a-09b1ba29a690 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057866 Jun 02 13:39:24.217092 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 255/484] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:24.223009 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d5d2f601-e1d3-4291-abf0-9cc0e67ea038 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:24.223922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d5d2f601-e1d3-4291-abf0-9cc0e67ea038 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:24.230493 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5d2f601-e1d3-4291-abf0-9cc0e67ea038 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:24.230947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5d2f601-e1d3-4291-abf0-9cc0e67ea038 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:24.231918 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5d2f601-e1d3-4291-abf0-9cc0e67ea038 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:24.232587 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5d2f601-e1d3-4291-abf0-9cc0e67ea038 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:24.238220 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c3083d1d-d42d-43d3-ad32-5a1e709b887c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:24.247751 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c3083d1d-d42d-43d3-ad32-5a1e709b887c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.187962 Jun 02 13:39:24.259274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 230/485] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:24 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:24.309989 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d5d2f601-e1d3-4291-abf0-9cc0e67ea038 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:24.318635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d5d2f601-e1d3-4291-abf0-9cc0e67ea038 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1204 microversion: 2.1 time: 0.099516 Jun 02 13:39:24.319570 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 256/486] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:24 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:24.385716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f8d049d6-93d6-4589-8c1c-ba00772ff7f8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:24.386515 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f8d049d6-93d6-4589-8c1c-ba00772ff7f8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:24.397144 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8d049d6-93d6-4589-8c1c-ba00772ff7f8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:24.397665 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8d049d6-93d6-4589-8c1c-ba00772ff7f8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:24.399052 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8d049d6-93d6-4589-8c1c-ba00772ff7f8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:24.399560 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8d049d6-93d6-4589-8c1c-ba00772ff7f8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:24.561253 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f8d049d6-93d6-4589-8c1c-ba00772ff7f8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:24.572586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f8d049d6-93d6-4589-8c1c-ba00772ff7f8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:24.573986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e7c77b3a-5ca1-47b0-9d4c-add8a9604dc1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:24.574469 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f8d049d6-93d6-4589-8c1c-ba00772ff7f8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:24.575925 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e7c77b3a-5ca1-47b0-9d4c-add8a9604dc1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:24.576102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f8d049d6-93d6-4589-8c1c-ba00772ff7f8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1722 microversion: 2.20 time: 0.193676 Jun 02 13:39:24.576712 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 231/487] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:24 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:24.595472 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7c77b3a-5ca1-47b0-9d4c-add8a9604dc1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:24.596009 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7c77b3a-5ca1-47b0-9d4c-add8a9604dc1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:24.597858 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7c77b3a-5ca1-47b0-9d4c-add8a9604dc1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:24.598435 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7c77b3a-5ca1-47b0-9d4c-add8a9604dc1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:24.777392 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e7c77b3a-5ca1-47b0-9d4c-add8a9604dc1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:24.786160 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e7c77b3a-5ca1-47b0-9d4c-add8a9604dc1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.217237 Jun 02 13:39:24.787449 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 257/488] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:24 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:25.264904 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a1c28392-8e00-4b7b-a6a2-69134f308607 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:25.265766 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a1c28392-8e00-4b7b-a6a2-69134f308607 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:25.269040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:25.275733 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a1c28392-8e00-4b7b-a6a2-69134f308607 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:25.276287 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a1c28392-8e00-4b7b-a6a2-69134f308607 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:25.277220 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a1c28392-8e00-4b7b-a6a2-69134f308607 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:25.277926 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a1c28392-8e00-4b7b-a6a2-69134f308607 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:25.336108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-46e96f81-8ab2-4020-a311-280821b5abfb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:25.336930 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-46e96f81-8ab2-4020-a311-280821b5abfb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:25.343518 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46e96f81-8ab2-4020-a311-280821b5abfb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:25.345043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46e96f81-8ab2-4020-a311-280821b5abfb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:25.345879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46e96f81-8ab2-4020-a311-280821b5abfb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:25.346921 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46e96f81-8ab2-4020-a311-280821b5abfb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:25.474899 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-46e96f81-8ab2-4020-a311-280821b5abfb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:25.484785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-46e96f81-8ab2-4020-a311-280821b5abfb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1204 microversion: 2.1 time: 0.152527 Jun 02 13:39:25.493717 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 258/489] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:25 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1204 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:25.532591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a1c28392-8e00-4b7b-a6a2-69134f308607 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:25.540742 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a1c28392-8e00-4b7b-a6a2-69134f308607 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.279604 Jun 02 13:39:25.541720 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 232/490] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:25 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:25.604041 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-214103f5-7e88-4dd7-bac7-f88229b5d9b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:25.616179 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-214103f5-7e88-4dd7-bac7-f88229b5d9b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:25.631874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-214103f5-7e88-4dd7-bac7-f88229b5d9b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:25.634175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-214103f5-7e88-4dd7-bac7-f88229b5d9b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:25.635703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-214103f5-7e88-4dd7-bac7-f88229b5d9b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:25.636498 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-214103f5-7e88-4dd7-bac7-f88229b5d9b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:25.812481 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3a2bbc36-0a42-4843-bbe6-4ecc69c382e8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:25.813216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3a2bbc36-0a42-4843-bbe6-4ecc69c382e8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:25.841088 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:25.845140 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a2bbc36-0a42-4843-bbe6-4ecc69c382e8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:25.845836 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a2bbc36-0a42-4843-bbe6-4ecc69c382e8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:25.847234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a2bbc36-0a42-4843-bbe6-4ecc69c382e8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:25.847675 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a2bbc36-0a42-4843-bbe6-4ecc69c382e8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:25.866291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:25.879927 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=6 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:26.069685 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-214103f5-7e88-4dd7-bac7-f88229b5d9b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:26.091052 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-214103f5-7e88-4dd7-bac7-f88229b5d9b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:26.097637 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-214103f5-7e88-4dd7-bac7-f88229b5d9b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:26.098879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-214103f5-7e88-4dd7-bac7-f88229b5d9b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1722 microversion: 2.20 time: 0.499737 Jun 02 13:39:26.099768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 259/491] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:25 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1722 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:26.178524 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a2bbc36-0a42-4843-bbe6-4ecc69c382e8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:26.187184 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3a2bbc36-0a42-4843-bbe6-4ecc69c382e8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.387869 Jun 02 13:39:26.188201 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 233/492] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:25 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:26.504658 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0634d3d6-f5c0-47d1-8d46-1bd70a1635ec tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:26.505567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0634d3d6-f5c0-47d1-8d46-1bd70a1635ec tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:26.520226 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0634d3d6-f5c0-47d1-8d46-1bd70a1635ec tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:26.520806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0634d3d6-f5c0-47d1-8d46-1bd70a1635ec tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:26.521710 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0634d3d6-f5c0-47d1-8d46-1bd70a1635ec tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:26.523929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0634d3d6-f5c0-47d1-8d46-1bd70a1635ec tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:26.565558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-70ab0548-a3a7-43e7-bd29-380d63acf6c3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:26.568377 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-70ab0548-a3a7-43e7-bd29-380d63acf6c3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:26.582442 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ab0548-a3a7-43e7-bd29-380d63acf6c3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:26.583155 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ab0548-a3a7-43e7-bd29-380d63acf6c3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:26.584763 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ab0548-a3a7-43e7-bd29-380d63acf6c3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:26.585525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ab0548-a3a7-43e7-bd29-380d63acf6c3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:26.683564 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:26.753700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:26.841207 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0634d3d6-f5c0-47d1-8d46-1bd70a1635ec tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:26.850287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0634d3d6-f5c0-47d1-8d46-1bd70a1635ec tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1272 microversion: 2.1 time: 0.350112 Jun 02 13:39:26.871664 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 260/493] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:26 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1272 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:26.938519 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70ab0548-a3a7-43e7-bd29-380d63acf6c3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:26.950200 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-70ab0548-a3a7-43e7-bd29-380d63acf6c3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1701 microversion: 2.1 time: 0.391839 Jun 02 13:39:26.951053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 234/494] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:26 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1701 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:26.970582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-32c38e58-c5a1-475c-803b-45d71608123a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:26.977887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32c38e58-c5a1-475c-803b-45d71608123a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:26.978593 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32c38e58-c5a1-475c-803b-45d71608123a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.061349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-32c38e58-c5a1-475c-803b-45d71608123a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Going to try to start instance {{(pid=124123) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 13:39:27.118018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-28486ed6-615c-47ec-b986-577560fafad0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:27.118626 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-28486ed6-615c-47ec-b986-577560fafad0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:27.129618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28486ed6-615c-47ec-b986-577560fafad0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:27.130286 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28486ed6-615c-47ec-b986-577560fafad0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.133443 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28486ed6-615c-47ec-b986-577560fafad0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:27.134144 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28486ed6-615c-47ec-b986-577560fafad0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.139972 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-32c38e58-c5a1-475c-803b-45d71608123a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/action" status: 202 len: 0 microversion: 2.1 time: 0.173180 Jun 02 13:39:27.140617 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 261/495] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:39:26 2022] POST /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:39:27.150459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8f93aefe-bebe-44d0-af2f-73fc3e571dc6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:27.151568 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8f93aefe-bebe-44d0-af2f-73fc3e571dc6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:27.159556 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8f93aefe-bebe-44d0-af2f-73fc3e571dc6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:27.160338 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8f93aefe-bebe-44d0-af2f-73fc3e571dc6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.161434 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8f93aefe-bebe-44d0-af2f-73fc3e571dc6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:27.162033 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8f93aefe-bebe-44d0-af2f-73fc3e571dc6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.363383 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-28486ed6-615c-47ec-b986-577560fafad0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:27.373379 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-28486ed6-615c-47ec-b986-577560fafad0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:27.376663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-28486ed6-615c-47ec-b986-577560fafad0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:27.378615 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-28486ed6-615c-47ec-b986-577560fafad0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1725 microversion: 2.20 time: 0.264888 Jun 02 13:39:27.379467 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 235/496] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:27 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1725 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:27.384460 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8f93aefe-bebe-44d0-af2f-73fc3e571dc6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:27.386006 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cab2f491-a0d6-40e2-8008-45ffbd7a9a71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:27.387266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cab2f491-a0d6-40e2-8008-45ffbd7a9a71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:27.394401 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8f93aefe-bebe-44d0-af2f-73fc3e571dc6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1710 microversion: 2.1 time: 0.248434 Jun 02 13:39:27.406072 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 262/497] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:27 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1710 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:27.406311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cab2f491-a0d6-40e2-8008-45ffbd7a9a71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:27.406311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cab2f491-a0d6-40e2-8008-45ffbd7a9a71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.406311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cab2f491-a0d6-40e2-8008-45ffbd7a9a71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:27.406311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cab2f491-a0d6-40e2-8008-45ffbd7a9a71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.406689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d018e38a-f1f0-4b63-90fb-773135ea54b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aa0d856-13e1-4925-a0ea-a8e102e77736"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:27.406689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d018e38a-f1f0-4b63-90fb-773135ea54b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:27.413127 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d018e38a-f1f0-4b63-90fb-773135ea54b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:27.413682 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d018e38a-f1f0-4b63-90fb-773135ea54b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.414527 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d018e38a-f1f0-4b63-90fb-773135ea54b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:27.415029 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d018e38a-f1f0-4b63-90fb-773135ea54b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.675074 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cab2f491-a0d6-40e2-8008-45ffbd7a9a71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:27.711766 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cab2f491-a0d6-40e2-8008-45ffbd7a9a71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1372 microversion: 2.1 time: 0.325156 Jun 02 13:39:27.713475 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 236/498] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:27 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:27.900477 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-02f2d45a-4f91-44a0-b414-abb389d33bdb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:27.902455 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-02f2d45a-4f91-44a0-b414-abb389d33bdb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:27.918170 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02f2d45a-4f91-44a0-b414-abb389d33bdb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:27.923835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02f2d45a-4f91-44a0-b414-abb389d33bdb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.926115 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02f2d45a-4f91-44a0-b414-abb389d33bdb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:27.928158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02f2d45a-4f91-44a0-b414-abb389d33bdb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:27.984657 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d018e38a-f1f0-4b63-90fb-773135ea54b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "POST /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.587269 Jun 02 13:39:27.988399 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 263/499] 10.222.0.32 () {62 vars in 1363 bytes} [Thu Jun 2 13:39:27 2022] POST /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments => generated 188 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:39:28.198699 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c396b43a-eac5-480c-8578-c3000eb72ca5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:28.200013 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c396b43a-eac5-480c-8578-c3000eb72ca5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:28.213462 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-02f2d45a-4f91-44a0-b414-abb389d33bdb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:28.222238 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-02f2d45a-4f91-44a0-b414-abb389d33bdb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1272 microversion: 2.1 time: 0.338703 Jun 02 13:39:28.234963 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 237/500] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:27 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:28.235656 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c396b43a-eac5-480c-8578-c3000eb72ca5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:28.236376 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c396b43a-eac5-480c-8578-c3000eb72ca5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:28.238047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c396b43a-eac5-480c-8578-c3000eb72ca5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:28.238661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c396b43a-eac5-480c-8578-c3000eb72ca5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:28.397817 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c396b43a-eac5-480c-8578-c3000eb72ca5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "POST /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/action" status: 202 len: 0 microversion: 2.20 time: 0.203161 Jun 02 13:39:28.402242 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 264/501] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Jun 2 13:39:28 2022] POST /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:39:28.407606 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d78523ce-6c71-4484-acbb-73e80a52b7d4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:28.408420 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d78523ce-6c71-4484-acbb-73e80a52b7d4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:28.425818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d78523ce-6c71-4484-acbb-73e80a52b7d4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:28.426498 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d78523ce-6c71-4484-acbb-73e80a52b7d4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:28.427534 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d78523ce-6c71-4484-acbb-73e80a52b7d4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:28.427741 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-446866ba-4550-480b-930b-3b334991314c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:28.428349 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d78523ce-6c71-4484-acbb-73e80a52b7d4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:28.429386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-446866ba-4550-480b-930b-3b334991314c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:28.451661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-446866ba-4550-480b-930b-3b334991314c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:28.453132 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-446866ba-4550-480b-930b-3b334991314c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:28.456714 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-446866ba-4550-480b-930b-3b334991314c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:28.457446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-446866ba-4550-480b-930b-3b334991314c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:28.795263 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d78523ce-6c71-4484-acbb-73e80a52b7d4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:28.811850 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d78523ce-6c71-4484-acbb-73e80a52b7d4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:28.827904 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d78523ce-6c71-4484-acbb-73e80a52b7d4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:28.831783 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d78523ce-6c71-4484-acbb-73e80a52b7d4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1751 microversion: 2.20 time: 0.428124 Jun 02 13:39:28.839521 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 238/502] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:28 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1751 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:28.847069 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-446866ba-4550-480b-930b-3b334991314c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:28.849583 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-549d4664-6dec-4266-ac03-adbd6ba011e9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:28.850225 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-549d4664-6dec-4266-ac03-adbd6ba011e9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:28.865086 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-446866ba-4550-480b-930b-3b334991314c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1710 microversion: 2.1 time: 0.449983 Jun 02 13:39:28.870641 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-549d4664-6dec-4266-ac03-adbd6ba011e9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:28.871100 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-549d4664-6dec-4266-ac03-adbd6ba011e9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:28.871882 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-549d4664-6dec-4266-ac03-adbd6ba011e9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:28.872336 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-549d4664-6dec-4266-ac03-adbd6ba011e9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:28.879135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 265/503] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:28 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1710 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:29.089978 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-16453c86-079b-4614-a1b4-9c9eee21e1f3 req-9f5b7a68-56c1-4d35-b434-3ed64a560185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38561783-c8ae-4094-b4c9-419507739f61", "tag": "f47de7fb-cfb6-4f5f-969c-a30939da7bf0"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:29.135687 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-16453c86-079b-4614-a1b4-9c9eee21e1f3 req-9f5b7a68-56c1-4d35-b434-3ed64a560185 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:29.136160 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-16453c86-079b-4614-a1b4-9c9eee21e1f3 req-9f5b7a68-56c1-4d35-b434-3ed64a560185 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:29.153361 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-16453c86-079b-4614-a1b4-9c9eee21e1f3 req-9f5b7a68-56c1-4d35-b434-3ed64a560185 service nova] Creating event network-changed:f47de7fb-cfb6-4f5f-969c-a30939da7bf0 for instance 38561783-c8ae-4094-b4c9-419507739f61 on hv-cinder-83608 Jun 02 13:39:29.160948 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-16453c86-079b-4614-a1b4-9c9eee21e1f3 req-9f5b7a68-56c1-4d35-b434-3ed64a560185 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075335 Jun 02 13:39:29.162052 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 266/504] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:29.239953 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a301c32f-5757-4f9d-ad20-1de716c220d9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:29.240956 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a301c32f-5757-4f9d-ad20-1de716c220d9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:29.276590 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a301c32f-5757-4f9d-ad20-1de716c220d9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:29.277045 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a301c32f-5757-4f9d-ad20-1de716c220d9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:29.277843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a301c32f-5757-4f9d-ad20-1de716c220d9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:29.278284 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a301c32f-5757-4f9d-ad20-1de716c220d9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:29.466967 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-549d4664-6dec-4266-ac03-adbd6ba011e9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:29.508136 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-549d4664-6dec-4266-ac03-adbd6ba011e9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1566 microversion: 2.1 time: 0.665046 Jun 02 13:39:29.509749 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 239/505] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:28 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1566 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:29.529748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-95ef10bd-a7f1-4ac5-9de6-ed61858ee9b4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:29.531525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-95ef10bd-a7f1-4ac5-9de6-ed61858ee9b4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:29.540371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-95ef10bd-a7f1-4ac5-9de6-ed61858ee9b4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:29.540941 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-95ef10bd-a7f1-4ac5-9de6-ed61858ee9b4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:29.541901 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-95ef10bd-a7f1-4ac5-9de6-ed61858ee9b4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:29.542461 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-95ef10bd-a7f1-4ac5-9de6-ed61858ee9b4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:30.093078 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-95ef10bd-a7f1-4ac5-9de6-ed61858ee9b4 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.570743 Jun 02 13:39:30.094776 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 240/506] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Jun 2 13:39:29 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-interface => generated 284 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:30.100696 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-53e9eae8-b94f-4c20-9605-ec7adb21dc3b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:30.101602 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-53e9eae8-b94f-4c20-9605-ec7adb21dc3b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:30.109686 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53e9eae8-b94f-4c20-9605-ec7adb21dc3b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:30.110431 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53e9eae8-b94f-4c20-9605-ec7adb21dc3b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:30.111460 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53e9eae8-b94f-4c20-9605-ec7adb21dc3b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:30.113427 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53e9eae8-b94f-4c20-9605-ec7adb21dc3b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:30.138903 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a301c32f-5757-4f9d-ad20-1de716c220d9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:30.141314 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:30.160092 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a301c32f-5757-4f9d-ad20-1de716c220d9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1272 microversion: 2.1 time: 0.920855 Jun 02 13:39:30.170377 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 267/507] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:29 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1272 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:30.176195 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-799422d4-d4cb-47d3-bfc7-c98ba56a3292 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:30.177161 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-799422d4-d4cb-47d3-bfc7-c98ba56a3292 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:30.185335 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-799422d4-d4cb-47d3-bfc7-c98ba56a3292 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:30.186186 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-799422d4-d4cb-47d3-bfc7-c98ba56a3292 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:30.187206 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-799422d4-d4cb-47d3-bfc7-c98ba56a3292 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:30.189461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-799422d4-d4cb-47d3-bfc7-c98ba56a3292 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:30.591819 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-53e9eae8-b94f-4c20-9605-ec7adb21dc3b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:30.604346 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-53e9eae8-b94f-4c20-9605-ec7adb21dc3b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:30.621403 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-53e9eae8-b94f-4c20-9605-ec7adb21dc3b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:30.623014 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-53e9eae8-b94f-4c20-9605-ec7adb21dc3b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1751 microversion: 2.20 time: 0.527027 Jun 02 13:39:30.624072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 241/508] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:30 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1751 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:30.657735 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-799422d4-d4cb-47d3-bfc7-c98ba56a3292 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:30.670539 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-799422d4-d4cb-47d3-bfc7-c98ba56a3292 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1710 microversion: 2.1 time: 0.498683 Jun 02 13:39:30.671185 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 268/509] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:30 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1710 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:31.177669 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-943aab2c-683d-4d4a-aa23-11ca6095b362 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:31.179303 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-943aab2c-683d-4d4a-aa23-11ca6095b362 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:31.196604 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-943aab2c-683d-4d4a-aa23-11ca6095b362 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:31.197631 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-943aab2c-683d-4d4a-aa23-11ca6095b362 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:31.199535 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-943aab2c-683d-4d4a-aa23-11ca6095b362 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:31.200929 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-943aab2c-683d-4d4a-aa23-11ca6095b362 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:31.394943 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-943aab2c-683d-4d4a-aa23-11ca6095b362 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:31.406505 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-943aab2c-683d-4d4a-aa23-11ca6095b362 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1272 microversion: 2.1 time: 0.232732 Jun 02 13:39:31.407796 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 242/510] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:31 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:31.531096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-668a9ebd-013b-45f8-8e4b-2a06cda3966e req-99d18be5-29e7-4e5b-9d72-884f523f0fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8851d9-9e33-4d8f-b120-f3b71a4f44a0", "tag": "331888dc-5e0f-4a52-be55-4b6a38503c9d"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:31.548209 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-668a9ebd-013b-45f8-8e4b-2a06cda3966e req-99d18be5-29e7-4e5b-9d72-884f523f0fa3 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:31.549450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-668a9ebd-013b-45f8-8e4b-2a06cda3966e req-99d18be5-29e7-4e5b-9d72-884f523f0fa3 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:31.568719 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-668a9ebd-013b-45f8-8e4b-2a06cda3966e req-99d18be5-29e7-4e5b-9d72-884f523f0fa3 service nova] Creating event network-changed:331888dc-5e0f-4a52-be55-4b6a38503c9d for instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 on hv-cinder-83608 Jun 02 13:39:31.574125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-668a9ebd-013b-45f8-8e4b-2a06cda3966e req-99d18be5-29e7-4e5b-9d72-884f523f0fa3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046835 Jun 02 13:39:31.574854 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 269/511] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:31.642663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-22a1622c-56a0-4384-9485-20457ac8d768 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:31.644371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-22a1622c-56a0-4384-9485-20457ac8d768 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:31.651559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-22a1622c-56a0-4384-9485-20457ac8d768 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:31.652173 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-22a1622c-56a0-4384-9485-20457ac8d768 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:31.653095 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-22a1622c-56a0-4384-9485-20457ac8d768 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:31.653633 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-22a1622c-56a0-4384-9485-20457ac8d768 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:31.687389 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-206e91dc-0eaf-4ebd-8715-6835a7332b62 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:31.688515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-206e91dc-0eaf-4ebd-8715-6835a7332b62 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:31.700174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-206e91dc-0eaf-4ebd-8715-6835a7332b62 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:31.701196 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-206e91dc-0eaf-4ebd-8715-6835a7332b62 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:31.713461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-206e91dc-0eaf-4ebd-8715-6835a7332b62 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:31.726791 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-206e91dc-0eaf-4ebd-8715-6835a7332b62 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:31.940718 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-22a1622c-56a0-4384-9485-20457ac8d768 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:31.951847 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-22a1622c-56a0-4384-9485-20457ac8d768 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:31.955894 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-22a1622c-56a0-4384-9485-20457ac8d768 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:31.967763 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-22a1622c-56a0-4384-9485-20457ac8d768 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1751 microversion: 2.20 time: 0.328849 Jun 02 13:39:31.968954 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 243/512] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:31 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1751 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:32.053551 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-206e91dc-0eaf-4ebd-8715-6835a7332b62 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:32.063625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-206e91dc-0eaf-4ebd-8715-6835a7332b62 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1710 microversion: 2.1 time: 0.380312 Jun 02 13:39:32.067274 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 270/513] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:31 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1710 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:32.422912 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b5cd138e-49dc-4f72-b3f7-b5c4adb7c86f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:32.423499 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b5cd138e-49dc-4f72-b3f7-b5c4adb7c86f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:32.431063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5cd138e-49dc-4f72-b3f7-b5c4adb7c86f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:32.435383 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5cd138e-49dc-4f72-b3f7-b5c4adb7c86f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:32.436415 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5cd138e-49dc-4f72-b3f7-b5c4adb7c86f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:32.439320 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5cd138e-49dc-4f72-b3f7-b5c4adb7c86f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:32.627294 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b5cd138e-49dc-4f72-b3f7-b5c4adb7c86f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:32.638639 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b5cd138e-49dc-4f72-b3f7-b5c4adb7c86f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1272 microversion: 2.1 time: 0.219538 Jun 02 13:39:32.648886 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 244/514] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:32 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:32.988061 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a49b4cda-70d9-43bf-9d45-020650ce4664 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:32.988805 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a49b4cda-70d9-43bf-9d45-020650ce4664 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:32.997124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a49b4cda-70d9-43bf-9d45-020650ce4664 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:32.997934 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a49b4cda-70d9-43bf-9d45-020650ce4664 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:32.998905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a49b4cda-70d9-43bf-9d45-020650ce4664 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:32.999419 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a49b4cda-70d9-43bf-9d45-020650ce4664 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:33.085307 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b57e59d9-8b70-497a-b2a6-f32d5ae86fdb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:33.085941 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b57e59d9-8b70-497a-b2a6-f32d5ae86fdb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:33.098447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b57e59d9-8b70-497a-b2a6-f32d5ae86fdb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:33.101175 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b57e59d9-8b70-497a-b2a6-f32d5ae86fdb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:33.102134 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b57e59d9-8b70-497a-b2a6-f32d5ae86fdb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:33.102583 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b57e59d9-8b70-497a-b2a6-f32d5ae86fdb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:33.399904 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a49b4cda-70d9-43bf-9d45-020650ce4664 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:33.419840 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a49b4cda-70d9-43bf-9d45-020650ce4664 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:33.423169 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a49b4cda-70d9-43bf-9d45-020650ce4664 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:33.425806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a49b4cda-70d9-43bf-9d45-020650ce4664 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1753 microversion: 2.20 time: 0.442156 Jun 02 13:39:33.428548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 271/515] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:32 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1753 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:33.556123 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b57e59d9-8b70-497a-b2a6-f32d5ae86fdb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:33.579496 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b57e59d9-8b70-497a-b2a6-f32d5ae86fdb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1714 microversion: 2.1 time: 0.497300 Jun 02 13:39:33.584437 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 245/516] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:33 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1714 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:33.657066 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-acbd678e-01e4-4dd8-92fc-d368acd9d224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:33.658028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-acbd678e-01e4-4dd8-92fc-d368acd9d224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:33.671000 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-acbd678e-01e4-4dd8-92fc-d368acd9d224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:33.675376 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-acbd678e-01e4-4dd8-92fc-d368acd9d224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:33.675887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-acbd678e-01e4-4dd8-92fc-d368acd9d224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:33.676364 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-acbd678e-01e4-4dd8-92fc-d368acd9d224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:33.997984 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4ccbe7a9-d462-423d-88fc-a7d8ddab33f2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:33.999972 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4ccbe7a9-d462-423d-88fc-a7d8ddab33f2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:34.009115 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ccbe7a9-d462-423d-88fc-a7d8ddab33f2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:34.011392 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ccbe7a9-d462-423d-88fc-a7d8ddab33f2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:34.012407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ccbe7a9-d462-423d-88fc-a7d8ddab33f2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:34.014098 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ccbe7a9-d462-423d-88fc-a7d8ddab33f2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:34.111162 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-acbd678e-01e4-4dd8-92fc-d368acd9d224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:34.122271 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-acbd678e-01e4-4dd8-92fc-d368acd9d224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1272 microversion: 2.1 time: 0.467283 Jun 02 13:39:34.128395 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 272/517] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:33 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1272 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:34.235853 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4ccbe7a9-d462-423d-88fc-a7d8ddab33f2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:34.249100 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4ccbe7a9-d462-423d-88fc-a7d8ddab33f2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1594 microversion: 2.1 time: 0.255774 Jun 02 13:39:34.252767 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 246/518] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:33 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1594 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:34.448150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2a440eed-1b25-49af-aa7d-5de5f10dc251 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:34.449081 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2a440eed-1b25-49af-aa7d-5de5f10dc251 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:34.451328 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:34.458167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a440eed-1b25-49af-aa7d-5de5f10dc251 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:34.458682 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a440eed-1b25-49af-aa7d-5de5f10dc251 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:34.459461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a440eed-1b25-49af-aa7d-5de5f10dc251 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:34.459918 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a440eed-1b25-49af-aa7d-5de5f10dc251 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:34.609769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2a440eed-1b25-49af-aa7d-5de5f10dc251 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:34.623354 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2a440eed-1b25-49af-aa7d-5de5f10dc251 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:34.629757 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2a440eed-1b25-49af-aa7d-5de5f10dc251 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:34.633541 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2a440eed-1b25-49af-aa7d-5de5f10dc251 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1753 microversion: 2.20 time: 0.189629 Jun 02 13:39:34.634826 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 273/519] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:34 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:35.139140 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-60b9b57f-62e7-479b-822c-2c3d3e84f15b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:35.139808 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-60b9b57f-62e7-479b-822c-2c3d3e84f15b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:35.146517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-60b9b57f-62e7-479b-822c-2c3d3e84f15b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:35.146978 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-60b9b57f-62e7-479b-822c-2c3d3e84f15b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:35.147742 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-60b9b57f-62e7-479b-822c-2c3d3e84f15b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:35.148188 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-60b9b57f-62e7-479b-822c-2c3d3e84f15b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:35.281899 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-60b9b57f-62e7-479b-822c-2c3d3e84f15b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:35.290754 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-60b9b57f-62e7-479b-822c-2c3d3e84f15b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.155661 Jun 02 13:39:35.291431 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 247/520] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:35 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:35.652864 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d8e45e49-cb24-4f7d-a65a-02f9ea87bbd9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:35.653604 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d8e45e49-cb24-4f7d-a65a-02f9ea87bbd9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:35.660700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8e45e49-cb24-4f7d-a65a-02f9ea87bbd9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:35.661216 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8e45e49-cb24-4f7d-a65a-02f9ea87bbd9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:35.661986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8e45e49-cb24-4f7d-a65a-02f9ea87bbd9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:35.662429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8e45e49-cb24-4f7d-a65a-02f9ea87bbd9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:35.790182 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d8e45e49-cb24-4f7d-a65a-02f9ea87bbd9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:35.799391 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d8e45e49-cb24-4f7d-a65a-02f9ea87bbd9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:35.801006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d8e45e49-cb24-4f7d-a65a-02f9ea87bbd9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:35.802232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d8e45e49-cb24-4f7d-a65a-02f9ea87bbd9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1753 microversion: 2.20 time: 0.153287 Jun 02 13:39:35.802889 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 274/521] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:35 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:36.039076 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-c3e62eeb-ba67-46e4-811e-1e977eeea767 req-fa5eb898-6b19-4b2b-855f-e4a4f142dfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2071a11-86aa-4a7f-962c-709f94eb7d6b", "tag": "46bae571-c4cf-494a-ae5d-a0def33d7330"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:36.050012 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-c3e62eeb-ba67-46e4-811e-1e977eeea767 req-fa5eb898-6b19-4b2b-855f-e4a4f142dfd5 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:36.050757 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-c3e62eeb-ba67-46e4-811e-1e977eeea767 req-fa5eb898-6b19-4b2b-855f-e4a4f142dfd5 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:36.062980 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-c3e62eeb-ba67-46e4-811e-1e977eeea767 req-fa5eb898-6b19-4b2b-855f-e4a4f142dfd5 service nova] Creating event network-changed:46bae571-c4cf-494a-ae5d-a0def33d7330 for instance e2071a11-86aa-4a7f-962c-709f94eb7d6b on hv-cinder-83608 Jun 02 13:39:36.068212 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-c3e62eeb-ba67-46e4-811e-1e977eeea767 req-fa5eb898-6b19-4b2b-855f-e4a4f142dfd5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032712 Jun 02 13:39:36.068903 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 248/522] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:39:36.313372 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-83d6cbef-092a-40b9-8cad-334dbbd857e5 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:36.315213 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-83d6cbef-092a-40b9-8cad-334dbbd857e5 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:36.324493 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83d6cbef-092a-40b9-8cad-334dbbd857e5 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:36.325269 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83d6cbef-092a-40b9-8cad-334dbbd857e5 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:36.326888 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83d6cbef-092a-40b9-8cad-334dbbd857e5 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:36.327698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83d6cbef-092a-40b9-8cad-334dbbd857e5 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:36.600209 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-83d6cbef-092a-40b9-8cad-334dbbd857e5 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:36.610670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-83d6cbef-092a-40b9-8cad-334dbbd857e5 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.304023 Jun 02 13:39:36.611693 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 275/523] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:36 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:36.824343 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-88ff5163-e2ec-41a0-b223-29be4ebd4358 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:36.825627 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-88ff5163-e2ec-41a0-b223-29be4ebd4358 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:36.835886 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88ff5163-e2ec-41a0-b223-29be4ebd4358 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:36.838679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88ff5163-e2ec-41a0-b223-29be4ebd4358 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:36.839758 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88ff5163-e2ec-41a0-b223-29be4ebd4358 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:36.840523 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88ff5163-e2ec-41a0-b223-29be4ebd4358 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:37.078194 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-88ff5163-e2ec-41a0-b223-29be4ebd4358 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:37.087351 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-88ff5163-e2ec-41a0-b223-29be4ebd4358 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:37.089871 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-88ff5163-e2ec-41a0-b223-29be4ebd4358 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:37.091392 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-88ff5163-e2ec-41a0-b223-29be4ebd4358 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.274125 Jun 02 13:39:37.103951 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 249/524] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:36 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:37.454384 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3b81252f-41cc-4e79-82a5-c6715baea8ec tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-286939575"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:37.455004 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3b81252f-41cc-4e79-82a5-c6715baea8ec tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:37.464850 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3b81252f-41cc-4e79-82a5-c6715baea8ec tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:37.465497 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3b81252f-41cc-4e79-82a5-c6715baea8ec tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:37.466266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3b81252f-41cc-4e79-82a5-c6715baea8ec tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:37.466702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3b81252f-41cc-4e79-82a5-c6715baea8ec tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:37.597377 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.network.security_group_api [None req-3b81252f-41cc-4e79-82a5-c6715baea8ec tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Adding security group 31056403-c1b8-411f-99a5-eb1b2b382769 to port 46bae571-c4cf-494a-ae5d-a0def33d7330 Jun 02 13:39:37.629218 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a64f7f95-3be2-4632-a41e-eba549f0f224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:37.630254 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a64f7f95-3be2-4632-a41e-eba549f0f224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:37.638792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a64f7f95-3be2-4632-a41e-eba549f0f224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:37.639637 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a64f7f95-3be2-4632-a41e-eba549f0f224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:37.640449 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a64f7f95-3be2-4632-a41e-eba549f0f224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:37.641158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a64f7f95-3be2-4632-a41e-eba549f0f224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:37.864766 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a64f7f95-3be2-4632-a41e-eba549f0f224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:37.867839 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:37.878362 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a64f7f95-3be2-4632-a41e-eba549f0f224 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.253971 Jun 02 13:39:37.884807 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 250/525] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:37 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:38.107027 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3b81252f-41cc-4e79-82a5-c6715baea8ec tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "POST /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/action" status: 202 len: 0 microversion: 2.1 time: 0.656787 Jun 02 13:39:38.107999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 276/526] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:39:37 2022] POST /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/action => generated 0 bytes in 659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:39:38.116160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-99ffd7b9-3911-4bd5-a76e-d2cf2c0da943 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:38.117023 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-99ffd7b9-3911-4bd5-a76e-d2cf2c0da943 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:38.117813 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-af0539c4-b0f2-4c30-adf3-fc87d5fc8496 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:38.118444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-af0539c4-b0f2-4c30-adf3-fc87d5fc8496 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:38.125753 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ffd7b9-3911-4bd5-a76e-d2cf2c0da943 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:38.126222 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ffd7b9-3911-4bd5-a76e-d2cf2c0da943 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:38.127762 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ffd7b9-3911-4bd5-a76e-d2cf2c0da943 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:38.128206 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ffd7b9-3911-4bd5-a76e-d2cf2c0da943 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:38.140645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af0539c4-b0f2-4c30-adf3-fc87d5fc8496 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:38.143217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af0539c4-b0f2-4c30-adf3-fc87d5fc8496 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:38.145144 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af0539c4-b0f2-4c30-adf3-fc87d5fc8496 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:38.148037 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af0539c4-b0f2-4c30-adf3-fc87d5fc8496 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:38.401718 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-af0539c4-b0f2-4c30-adf3-fc87d5fc8496 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:38.410691 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-af0539c4-b0f2-4c30-adf3-fc87d5fc8496 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1759 microversion: 2.1 time: 0.297722 Jun 02 13:39:38.423785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 277/527] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:38 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1759 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:38.428793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-2b571abc-6c0c-406f-a5bc-8d43b0712922 req-520ef53e-ea35-42dc-aa9e-b1e03b69eee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2071a11-86aa-4a7f-962c-709f94eb7d6b", "tag": "46bae571-c4cf-494a-ae5d-a0def33d7330"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:38.448785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-2b571abc-6c0c-406f-a5bc-8d43b0712922 req-520ef53e-ea35-42dc-aa9e-b1e03b69eee5 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:38.449459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-99ffd7b9-3911-4bd5-a76e-d2cf2c0da943 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:38.449878 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-2b571abc-6c0c-406f-a5bc-8d43b0712922 req-520ef53e-ea35-42dc-aa9e-b1e03b69eee5 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:38.459450 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-99ffd7b9-3911-4bd5-a76e-d2cf2c0da943 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:38.467502 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-99ffd7b9-3911-4bd5-a76e-d2cf2c0da943 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:38.468467 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-2b571abc-6c0c-406f-a5bc-8d43b0712922 req-520ef53e-ea35-42dc-aa9e-b1e03b69eee5 service nova] Creating event network-changed:46bae571-c4cf-494a-ae5d-a0def33d7330 for instance e2071a11-86aa-4a7f-962c-709f94eb7d6b on hv-cinder-83608 Jun 02 13:39:38.470127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-99ffd7b9-3911-4bd5-a76e-d2cf2c0da943 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.364015 Jun 02 13:39:38.473309 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 251/528] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:38 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:39:38.474764 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-2b571abc-6c0c-406f-a5bc-8d43b0712922 req-520ef53e-ea35-42dc-aa9e-b1e03b69eee5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048481 Jun 02 13:39:38.475461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 278/529] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:38.896653 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dd9a182b-a843-4b0f-a811-96c5a43661e8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:38.898101 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dd9a182b-a843-4b0f-a811-96c5a43661e8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:38.907025 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd9a182b-a843-4b0f-a811-96c5a43661e8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:38.907722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd9a182b-a843-4b0f-a811-96c5a43661e8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:38.909389 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd9a182b-a843-4b0f-a811-96c5a43661e8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:38.910251 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd9a182b-a843-4b0f-a811-96c5a43661e8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:39.272530 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dd9a182b-a843-4b0f-a811-96c5a43661e8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:39.282037 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dd9a182b-a843-4b0f-a811-96c5a43661e8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.390790 Jun 02 13:39:39.282978 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 252/530] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:38 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:39.491542 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d15694f9-4bdf-4085-99ca-468aef47e83f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:39.492244 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d15694f9-4bdf-4085-99ca-468aef47e83f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:39.502411 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d15694f9-4bdf-4085-99ca-468aef47e83f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:39.502860 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d15694f9-4bdf-4085-99ca-468aef47e83f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:39.503870 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d15694f9-4bdf-4085-99ca-468aef47e83f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:39.504333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d15694f9-4bdf-4085-99ca-468aef47e83f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:39.685542 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d15694f9-4bdf-4085-99ca-468aef47e83f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:39.701550 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d15694f9-4bdf-4085-99ca-468aef47e83f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:39.703185 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d15694f9-4bdf-4085-99ca-468aef47e83f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:39.704758 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d15694f9-4bdf-4085-99ca-468aef47e83f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.217447 Jun 02 13:39:39.705427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 279/531] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:39 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:40.301857 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b6b22ced-23d7-426a-b6e3-f8b11d157df7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:40.303098 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b6b22ced-23d7-426a-b6e3-f8b11d157df7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:40.318220 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b6b22ced-23d7-426a-b6e3-f8b11d157df7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:40.321096 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b6b22ced-23d7-426a-b6e3-f8b11d157df7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:40.322130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b6b22ced-23d7-426a-b6e3-f8b11d157df7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:40.322576 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b6b22ced-23d7-426a-b6e3-f8b11d157df7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:40.492501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b6b22ced-23d7-426a-b6e3-f8b11d157df7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:40.500414 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b6b22ced-23d7-426a-b6e3-f8b11d157df7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.204925 Jun 02 13:39:40.510696 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 253/532] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:40 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:40.722881 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ba3caac5-dc39-42d3-9309-fd0c3346f729 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:40.723509 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ba3caac5-dc39-42d3-9309-fd0c3346f729 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:40.730767 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba3caac5-dc39-42d3-9309-fd0c3346f729 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:40.731308 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba3caac5-dc39-42d3-9309-fd0c3346f729 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:40.732138 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba3caac5-dc39-42d3-9309-fd0c3346f729 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:40.732685 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba3caac5-dc39-42d3-9309-fd0c3346f729 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:40.921791 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ba3caac5-dc39-42d3-9309-fd0c3346f729 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:40.932943 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ba3caac5-dc39-42d3-9309-fd0c3346f729 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:40.934481 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ba3caac5-dc39-42d3-9309-fd0c3346f729 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:40.935800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ba3caac5-dc39-42d3-9309-fd0c3346f729 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.216892 Jun 02 13:39:40.936967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 280/533] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:40 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:41.518122 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e4183ba9-2f0a-40c0-9ab2-c4b1a5bc102b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:41.519225 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e4183ba9-2f0a-40c0-9ab2-c4b1a5bc102b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:41.525988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4183ba9-2f0a-40c0-9ab2-c4b1a5bc102b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:41.526437 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4183ba9-2f0a-40c0-9ab2-c4b1a5bc102b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:41.527209 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4183ba9-2f0a-40c0-9ab2-c4b1a5bc102b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:41.527642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4183ba9-2f0a-40c0-9ab2-c4b1a5bc102b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:41.671540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e4183ba9-2f0a-40c0-9ab2-c4b1a5bc102b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:41.679585 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e4183ba9-2f0a-40c0-9ab2-c4b1a5bc102b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.165650 Jun 02 13:39:41.680136 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 254/534] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:41 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:41.956930 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a8abf28d-437a-41df-859e-07f22c9769e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:41.957676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a8abf28d-437a-41df-859e-07f22c9769e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:41.964691 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8abf28d-437a-41df-859e-07f22c9769e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:41.965143 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8abf28d-437a-41df-859e-07f22c9769e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:41.966123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8abf28d-437a-41df-859e-07f22c9769e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:41.966555 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8abf28d-437a-41df-859e-07f22c9769e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:42.127211 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a8abf28d-437a-41df-859e-07f22c9769e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:42.140893 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a8abf28d-437a-41df-859e-07f22c9769e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:42.143715 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a8abf28d-437a-41df-859e-07f22c9769e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:42.145623 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a8abf28d-437a-41df-859e-07f22c9769e1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.194114 Jun 02 13:39:42.146305 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 281/535] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:41 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:42.697019 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-eb3cc3e4-65d8-4208-beda-93be3fd2789e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:42.697575 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-eb3cc3e4-65d8-4208-beda-93be3fd2789e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:42.704509 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb3cc3e4-65d8-4208-beda-93be3fd2789e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:42.704967 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb3cc3e4-65d8-4208-beda-93be3fd2789e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:42.705739 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb3cc3e4-65d8-4208-beda-93be3fd2789e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:42.706180 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb3cc3e4-65d8-4208-beda-93be3fd2789e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:42.859462 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-eb3cc3e4-65d8-4208-beda-93be3fd2789e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:42.867670 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-eb3cc3e4-65d8-4208-beda-93be3fd2789e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.174663 Jun 02 13:39:42.868237 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 255/536] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:42 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:43.165258 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-89ad0de7-b7b1-4580-a1ee-287b0de6584a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:43.165919 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-89ad0de7-b7b1-4580-a1ee-287b0de6584a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:43.172721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-89ad0de7-b7b1-4580-a1ee-287b0de6584a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:43.173193 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-89ad0de7-b7b1-4580-a1ee-287b0de6584a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:43.173909 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-89ad0de7-b7b1-4580-a1ee-287b0de6584a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:43.174401 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-89ad0de7-b7b1-4580-a1ee-287b0de6584a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:43.314812 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-89ad0de7-b7b1-4580-a1ee-287b0de6584a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:43.325028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-89ad0de7-b7b1-4580-a1ee-287b0de6584a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:43.326914 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-89ad0de7-b7b1-4580-a1ee-287b0de6584a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:43.328238 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-89ad0de7-b7b1-4580-a1ee-287b0de6584a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.166789 Jun 02 13:39:43.329229 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 282/537] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:43 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:43.953657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8cb62f95-35a2-4bc7-a507-7ece80b95a9a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:43.954539 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8cb62f95-35a2-4bc7-a507-7ece80b95a9a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:43.961511 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cb62f95-35a2-4bc7-a507-7ece80b95a9a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:43.962315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cb62f95-35a2-4bc7-a507-7ece80b95a9a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:43.963314 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cb62f95-35a2-4bc7-a507-7ece80b95a9a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:43.963960 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cb62f95-35a2-4bc7-a507-7ece80b95a9a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:44.123928 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8cb62f95-35a2-4bc7-a507-7ece80b95a9a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:44.132746 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8cb62f95-35a2-4bc7-a507-7ece80b95a9a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.185353 Jun 02 13:39:44.133314 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 256/538] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:43 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:44.348094 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-516a91c7-6c28-4d70-a850-d0d219ec8d25 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:44.348743 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-516a91c7-6c28-4d70-a850-d0d219ec8d25 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:44.355355 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-516a91c7-6c28-4d70-a850-d0d219ec8d25 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:44.355811 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-516a91c7-6c28-4d70-a850-d0d219ec8d25 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:44.356617 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-516a91c7-6c28-4d70-a850-d0d219ec8d25 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:44.357061 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-516a91c7-6c28-4d70-a850-d0d219ec8d25 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:44.540631 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-516a91c7-6c28-4d70-a850-d0d219ec8d25 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:44.557681 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-516a91c7-6c28-4d70-a850-d0d219ec8d25 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:44.559510 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-516a91c7-6c28-4d70-a850-d0d219ec8d25 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:44.561471 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-516a91c7-6c28-4d70-a850-d0d219ec8d25 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.217639 Jun 02 13:39:44.562598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 283/539] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:44 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:45.150453 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c73da3a4-21dc-499e-9a30-70816d1b9ad9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:45.151886 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c73da3a4-21dc-499e-9a30-70816d1b9ad9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:45.159288 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c73da3a4-21dc-499e-9a30-70816d1b9ad9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:45.160008 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c73da3a4-21dc-499e-9a30-70816d1b9ad9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:45.161001 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c73da3a4-21dc-499e-9a30-70816d1b9ad9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:45.161600 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c73da3a4-21dc-499e-9a30-70816d1b9ad9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:45.308944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c73da3a4-21dc-499e-9a30-70816d1b9ad9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:45.317797 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c73da3a4-21dc-499e-9a30-70816d1b9ad9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.171506 Jun 02 13:39:45.318365 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 257/540] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:45 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:45.583508 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1af38cc1-5a75-42a1-8302-3a82051c88fc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:45.584805 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1af38cc1-5a75-42a1-8302-3a82051c88fc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:45.602266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1af38cc1-5a75-42a1-8302-3a82051c88fc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:45.602913 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1af38cc1-5a75-42a1-8302-3a82051c88fc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:45.603714 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1af38cc1-5a75-42a1-8302-3a82051c88fc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:45.604382 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1af38cc1-5a75-42a1-8302-3a82051c88fc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:45.753393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1af38cc1-5a75-42a1-8302-3a82051c88fc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:45.762669 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1af38cc1-5a75-42a1-8302-3a82051c88fc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:45.764806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1af38cc1-5a75-42a1-8302-3a82051c88fc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:45.766424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1af38cc1-5a75-42a1-8302-3a82051c88fc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.187566 Jun 02 13:39:45.780333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 284/541] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:45 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:46.334739 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d78a7826-2d5e-44b2-aa88-b1c927ef1c8d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:46.335357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d78a7826-2d5e-44b2-aa88-b1c927ef1c8d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:46.343327 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d78a7826-2d5e-44b2-aa88-b1c927ef1c8d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:46.343787 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d78a7826-2d5e-44b2-aa88-b1c927ef1c8d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:46.344646 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d78a7826-2d5e-44b2-aa88-b1c927ef1c8d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:46.345082 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d78a7826-2d5e-44b2-aa88-b1c927ef1c8d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:46.492451 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d78a7826-2d5e-44b2-aa88-b1c927ef1c8d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:46.500441 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d78a7826-2d5e-44b2-aa88-b1c927ef1c8d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.169429 Jun 02 13:39:46.501224 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 258/542] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:46 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:46.787485 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-518ce34b-4ad9-49d5-a705-e9da3aa913ac tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:46.788092 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-518ce34b-4ad9-49d5-a705-e9da3aa913ac tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:46.795213 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-518ce34b-4ad9-49d5-a705-e9da3aa913ac tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:46.795874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-518ce34b-4ad9-49d5-a705-e9da3aa913ac tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:46.796771 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-518ce34b-4ad9-49d5-a705-e9da3aa913ac tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:46.797211 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-518ce34b-4ad9-49d5-a705-e9da3aa913ac tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:46.961034 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-518ce34b-4ad9-49d5-a705-e9da3aa913ac tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:46.970373 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-518ce34b-4ad9-49d5-a705-e9da3aa913ac tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:46.972149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-518ce34b-4ad9-49d5-a705-e9da3aa913ac tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:46.973466 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-518ce34b-4ad9-49d5-a705-e9da3aa913ac tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.190334 Jun 02 13:39:46.974144 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 285/543] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:46 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:47.518307 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-be8bb056-0a7a-44cf-8ece-1dfb7a7f7370 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:47.518944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-be8bb056-0a7a-44cf-8ece-1dfb7a7f7370 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:47.525943 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be8bb056-0a7a-44cf-8ece-1dfb7a7f7370 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:47.526403 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be8bb056-0a7a-44cf-8ece-1dfb7a7f7370 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:47.527231 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be8bb056-0a7a-44cf-8ece-1dfb7a7f7370 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:47.527672 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be8bb056-0a7a-44cf-8ece-1dfb7a7f7370 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:47.677997 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-be8bb056-0a7a-44cf-8ece-1dfb7a7f7370 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:47.685996 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-be8bb056-0a7a-44cf-8ece-1dfb7a7f7370 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.171975 Jun 02 13:39:47.687047 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 259/544] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:47 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:47.992055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-dc6a5db6-f13b-4210-bf45-89042fc863d3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:47.992708 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-dc6a5db6-f13b-4210-bf45-89042fc863d3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:47.999348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dc6a5db6-f13b-4210-bf45-89042fc863d3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:47.999798 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dc6a5db6-f13b-4210-bf45-89042fc863d3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:48.000583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dc6a5db6-f13b-4210-bf45-89042fc863d3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:48.001022 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dc6a5db6-f13b-4210-bf45-89042fc863d3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:48.004387 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:48.156949 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-dc6a5db6-f13b-4210-bf45-89042fc863d3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:48.166452 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-dc6a5db6-f13b-4210-bf45-89042fc863d3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:48.168133 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-dc6a5db6-f13b-4210-bf45-89042fc863d3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:48.169396 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-dc6a5db6-f13b-4210-bf45-89042fc863d3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.181233 Jun 02 13:39:48.169954 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 286/545] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:47 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:48.705544 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-27410502-ee22-414b-ba81-d80222fcabe1 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:48.706164 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-27410502-ee22-414b-ba81-d80222fcabe1 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:48.712570 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27410502-ee22-414b-ba81-d80222fcabe1 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:48.713018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27410502-ee22-414b-ba81-d80222fcabe1 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:48.713778 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27410502-ee22-414b-ba81-d80222fcabe1 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:48.714207 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27410502-ee22-414b-ba81-d80222fcabe1 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:48.847476 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-27410502-ee22-414b-ba81-d80222fcabe1 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:48.855212 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-27410502-ee22-414b-ba81-d80222fcabe1 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.154393 Jun 02 13:39:48.855780 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 260/546] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:48 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:49.187020 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-819341cf-1635-4a2a-9461-bb6c8894f4df tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:49.188397 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-819341cf-1635-4a2a-9461-bb6c8894f4df tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:49.196325 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-819341cf-1635-4a2a-9461-bb6c8894f4df tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:49.197123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-819341cf-1635-4a2a-9461-bb6c8894f4df tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:49.198149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-819341cf-1635-4a2a-9461-bb6c8894f4df tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:49.198805 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-819341cf-1635-4a2a-9461-bb6c8894f4df tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:49.329825 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-819341cf-1635-4a2a-9461-bb6c8894f4df tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:49.338782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-819341cf-1635-4a2a-9461-bb6c8894f4df tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:49.340396 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-819341cf-1635-4a2a-9461-bb6c8894f4df tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:49.341681 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-819341cf-1635-4a2a-9461-bb6c8894f4df tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.158526 Jun 02 13:39:49.342784 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 287/547] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:49 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:49.872010 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5c881e0b-be9a-4198-8dfa-d52108c07d7f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:49.872664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5c881e0b-be9a-4198-8dfa-d52108c07d7f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:49.879097 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c881e0b-be9a-4198-8dfa-d52108c07d7f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:49.879542 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c881e0b-be9a-4198-8dfa-d52108c07d7f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:49.880318 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c881e0b-be9a-4198-8dfa-d52108c07d7f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:49.880829 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c881e0b-be9a-4198-8dfa-d52108c07d7f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:50.029342 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5c881e0b-be9a-4198-8dfa-d52108c07d7f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:50.036851 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5c881e0b-be9a-4198-8dfa-d52108c07d7f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.168767 Jun 02 13:39:50.037387 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 261/548] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:49 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:50.362878 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-57b968ec-0994-4518-b19d-65115df0989f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:50.363601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-57b968ec-0994-4518-b19d-65115df0989f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:50.370099 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-57b968ec-0994-4518-b19d-65115df0989f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:50.370546 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-57b968ec-0994-4518-b19d-65115df0989f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:50.371297 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-57b968ec-0994-4518-b19d-65115df0989f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:50.371732 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-57b968ec-0994-4518-b19d-65115df0989f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:50.504844 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-57b968ec-0994-4518-b19d-65115df0989f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:50.513507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-57b968ec-0994-4518-b19d-65115df0989f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:50.515028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-57b968ec-0994-4518-b19d-65115df0989f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:50.516188 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-57b968ec-0994-4518-b19d-65115df0989f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.158498 Jun 02 13:39:50.516778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 288/549] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:50 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:51.053887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c0ea644e-e9c7-4969-833f-4d7671e95527 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:51.054507 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c0ea644e-e9c7-4969-833f-4d7671e95527 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:51.061014 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c0ea644e-e9c7-4969-833f-4d7671e95527 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:51.061467 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c0ea644e-e9c7-4969-833f-4d7671e95527 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:51.062226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c0ea644e-e9c7-4969-833f-4d7671e95527 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:51.062667 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c0ea644e-e9c7-4969-833f-4d7671e95527 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:51.430238 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c0ea644e-e9c7-4969-833f-4d7671e95527 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:51.438004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c0ea644e-e9c7-4969-833f-4d7671e95527 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.387985 Jun 02 13:39:51.438562 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 262/550] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:51 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:39:51.535493 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-946cc1db-358f-4b7d-a89e-ec0cf4106ff6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:51.536108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-946cc1db-358f-4b7d-a89e-ec0cf4106ff6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:51.542684 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-946cc1db-358f-4b7d-a89e-ec0cf4106ff6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:51.543141 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-946cc1db-358f-4b7d-a89e-ec0cf4106ff6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:51.543907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-946cc1db-358f-4b7d-a89e-ec0cf4106ff6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:51.544379 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-946cc1db-358f-4b7d-a89e-ec0cf4106ff6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:51.671080 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-946cc1db-358f-4b7d-a89e-ec0cf4106ff6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:51.679476 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-946cc1db-358f-4b7d-a89e-ec0cf4106ff6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:51.681028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-946cc1db-358f-4b7d-a89e-ec0cf4106ff6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:51.682191 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-946cc1db-358f-4b7d-a89e-ec0cf4106ff6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.151213 Jun 02 13:39:51.682747 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 289/551] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:51 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:52.454523 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-55e0ece3-83fd-4963-b63e-df759ca544bc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:52.455135 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-55e0ece3-83fd-4963-b63e-df759ca544bc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:52.462016 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55e0ece3-83fd-4963-b63e-df759ca544bc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:52.462640 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55e0ece3-83fd-4963-b63e-df759ca544bc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:52.463424 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55e0ece3-83fd-4963-b63e-df759ca544bc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:52.463867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55e0ece3-83fd-4963-b63e-df759ca544bc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:52.597721 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-55e0ece3-83fd-4963-b63e-df759ca544bc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:52.605186 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-55e0ece3-83fd-4963-b63e-df759ca544bc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.154869 Jun 02 13:39:52.605745 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 263/552] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:52 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:52.700871 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bdfc1991-1bd6-4094-bf34-bd00f32028b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:52.701515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bdfc1991-1bd6-4094-bf34-bd00f32028b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:52.708461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bdfc1991-1bd6-4094-bf34-bd00f32028b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:52.708914 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bdfc1991-1bd6-4094-bf34-bd00f32028b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:52.709672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bdfc1991-1bd6-4094-bf34-bd00f32028b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:52.710105 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bdfc1991-1bd6-4094-bf34-bd00f32028b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:52.840196 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bdfc1991-1bd6-4094-bf34-bd00f32028b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:52.849388 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bdfc1991-1bd6-4094-bf34-bd00f32028b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:52.850826 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bdfc1991-1bd6-4094-bf34-bd00f32028b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:52.851969 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bdfc1991-1bd6-4094-bf34-bd00f32028b4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.155056 Jun 02 13:39:52.852553 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 290/553] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:52 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:53.622482 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b41cc6da-b25d-4919-8134-9cb23e45f892 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:53.623121 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b41cc6da-b25d-4919-8134-9cb23e45f892 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:53.630241 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b41cc6da-b25d-4919-8134-9cb23e45f892 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:53.630682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b41cc6da-b25d-4919-8134-9cb23e45f892 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:53.631447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b41cc6da-b25d-4919-8134-9cb23e45f892 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:53.631877 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b41cc6da-b25d-4919-8134-9cb23e45f892 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:53.774088 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b41cc6da-b25d-4919-8134-9cb23e45f892 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:53.782303 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b41cc6da-b25d-4919-8134-9cb23e45f892 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.163576 Jun 02 13:39:53.782893 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 264/554] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:53 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:53.869455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-17fdff69-cbad-4855-9c3e-69e16584522a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:53.869998 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-17fdff69-cbad-4855-9c3e-69e16584522a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:53.878006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17fdff69-cbad-4855-9c3e-69e16584522a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:53.878536 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17fdff69-cbad-4855-9c3e-69e16584522a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:53.879344 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17fdff69-cbad-4855-9c3e-69e16584522a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:53.879887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17fdff69-cbad-4855-9c3e-69e16584522a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:54.023540 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-17fdff69-cbad-4855-9c3e-69e16584522a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:54.033833 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-17fdff69-cbad-4855-9c3e-69e16584522a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:54.035339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-17fdff69-cbad-4855-9c3e-69e16584522a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:54.036604 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-17fdff69-cbad-4855-9c3e-69e16584522a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.171041 Jun 02 13:39:54.037180 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 291/555] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:53 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:54.799916 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5f59f211-1a43-491f-8c71-94011092b19f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:54.800571 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5f59f211-1a43-491f-8c71-94011092b19f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:54.807442 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f59f211-1a43-491f-8c71-94011092b19f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:54.807902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f59f211-1a43-491f-8c71-94011092b19f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:54.808701 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f59f211-1a43-491f-8c71-94011092b19f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:54.809142 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f59f211-1a43-491f-8c71-94011092b19f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:54.938820 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5f59f211-1a43-491f-8c71-94011092b19f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:54.946496 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5f59f211-1a43-491f-8c71-94011092b19f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.151427 Jun 02 13:39:54.947062 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 265/556] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:54 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:55.055104 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e38def9c-e6b3-47d2-a9c1-69f75eb102e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:55.055745 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e38def9c-e6b3-47d2-a9c1-69f75eb102e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:55.062426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e38def9c-e6b3-47d2-a9c1-69f75eb102e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:55.062877 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e38def9c-e6b3-47d2-a9c1-69f75eb102e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:55.063647 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e38def9c-e6b3-47d2-a9c1-69f75eb102e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:55.064135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e38def9c-e6b3-47d2-a9c1-69f75eb102e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:55.198202 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e38def9c-e6b3-47d2-a9c1-69f75eb102e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:55.206850 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e38def9c-e6b3-47d2-a9c1-69f75eb102e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:55.208394 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e38def9c-e6b3-47d2-a9c1-69f75eb102e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:55.209544 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e38def9c-e6b3-47d2-a9c1-69f75eb102e0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.158774 Jun 02 13:39:55.210100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 292/557] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:55 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:55.845938 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-0ccb6fef-aa02-476d-8329-437a242437ac req-4132df29-cf1d-4eec-916a-49679d889302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38561783-c8ae-4094-b4c9-419507739f61", "name": "network-vif-plugged", "status": "completed", "tag": "f47de7fb-cfb6-4f5f-969c-a30939da7bf0"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:39:55.850987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=68 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:55.858108 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-0ccb6fef-aa02-476d-8329-437a242437ac req-4132df29-cf1d-4eec-916a-49679d889302 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:55.858557 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-0ccb6fef-aa02-476d-8329-437a242437ac req-4132df29-cf1d-4eec-916a-49679d889302 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:55.870278 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-0ccb6fef-aa02-476d-8329-437a242437ac req-4132df29-cf1d-4eec-916a-49679d889302 service nova] Creating event network-vif-plugged:f47de7fb-cfb6-4f5f-969c-a30939da7bf0 for instance 38561783-c8ae-4094-b4c9-419507739f61 on hv-cinder-83608 Jun 02 13:39:55.875274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-0ccb6fef-aa02-476d-8329-437a242437ac req-4132df29-cf1d-4eec-916a-49679d889302 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034566 Jun 02 13:39:55.875865 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 266/558] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:39:55.963165 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c904ea49-4352-4d66-bf49-07f64780cdbe tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:55.963936 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c904ea49-4352-4d66-bf49-07f64780cdbe tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:55.970729 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c904ea49-4352-4d66-bf49-07f64780cdbe tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:55.971209 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c904ea49-4352-4d66-bf49-07f64780cdbe tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:55.971976 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c904ea49-4352-4d66-bf49-07f64780cdbe tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:55.972440 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c904ea49-4352-4d66-bf49-07f64780cdbe tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:56.101334 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c904ea49-4352-4d66-bf49-07f64780cdbe tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:56.108924 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c904ea49-4352-4d66-bf49-07f64780cdbe tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.149573 Jun 02 13:39:56.109770 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 293/559] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:55 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:56.228364 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1bea0e98-d302-4dcc-b734-7dd9e3b74f28 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:56.229145 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1bea0e98-d302-4dcc-b734-7dd9e3b74f28 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:56.237117 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bea0e98-d302-4dcc-b734-7dd9e3b74f28 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:56.237561 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bea0e98-d302-4dcc-b734-7dd9e3b74f28 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:56.238325 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bea0e98-d302-4dcc-b734-7dd9e3b74f28 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:56.238759 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bea0e98-d302-4dcc-b734-7dd9e3b74f28 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:56.370409 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1bea0e98-d302-4dcc-b734-7dd9e3b74f28 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:56.379751 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1bea0e98-d302-4dcc-b734-7dd9e3b74f28 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:56.381279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1bea0e98-d302-4dcc-b734-7dd9e3b74f28 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:56.382422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1bea0e98-d302-4dcc-b734-7dd9e3b74f28 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.158838 Jun 02 13:39:56.382973 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 267/560] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:56 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:57.125116 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9b430740-c20a-4966-80f0-9a9154a1d210 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:57.125749 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9b430740-c20a-4966-80f0-9a9154a1d210 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:57.132640 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9b430740-c20a-4966-80f0-9a9154a1d210 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:57.133100 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9b430740-c20a-4966-80f0-9a9154a1d210 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:57.133873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9b430740-c20a-4966-80f0-9a9154a1d210 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:57.134314 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9b430740-c20a-4966-80f0-9a9154a1d210 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:57.269435 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9b430740-c20a-4966-80f0-9a9154a1d210 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:57.276814 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9b430740-c20a-4966-80f0-9a9154a1d210 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.156028 Jun 02 13:39:57.277373 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 294/561] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:57 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:57.401438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1bc69078-77fd-44de-ac48-f856af06ab33 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:57.402054 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1bc69078-77fd-44de-ac48-f856af06ab33 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:57.409191 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bc69078-77fd-44de-ac48-f856af06ab33 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:57.409642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bc69078-77fd-44de-ac48-f856af06ab33 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:57.410403 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bc69078-77fd-44de-ac48-f856af06ab33 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:57.410841 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bc69078-77fd-44de-ac48-f856af06ab33 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:57.414827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:39:57.536627 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1bc69078-77fd-44de-ac48-f856af06ab33 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:57.544897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1bc69078-77fd-44de-ac48-f856af06ab33 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:57.546431 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1bc69078-77fd-44de-ac48-f856af06ab33 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:57.547565 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1bc69078-77fd-44de-ac48-f856af06ab33 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.149992 Jun 02 13:39:57.548114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 268/562] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:57 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:39:58.293943 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4b8cad2b-3501-4ef4-825d-8bd32d9317fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:58.294555 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4b8cad2b-3501-4ef4-825d-8bd32d9317fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:58.301735 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4b8cad2b-3501-4ef4-825d-8bd32d9317fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:58.302188 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4b8cad2b-3501-4ef4-825d-8bd32d9317fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:58.302949 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4b8cad2b-3501-4ef4-825d-8bd32d9317fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:58.303590 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4b8cad2b-3501-4ef4-825d-8bd32d9317fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:58.433806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4b8cad2b-3501-4ef4-825d-8bd32d9317fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:58.441145 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4b8cad2b-3501-4ef4-825d-8bd32d9317fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1260 microversion: 2.1 time: 0.151101 Jun 02 13:39:58.441738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 295/563] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:58 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:58.565534 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cd24a9e5-a94e-4a21-9c86-a2e63af534f0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:58.566080 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cd24a9e5-a94e-4a21-9c86-a2e63af534f0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:58.572586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd24a9e5-a94e-4a21-9c86-a2e63af534f0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:58.573040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd24a9e5-a94e-4a21-9c86-a2e63af534f0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:58.573801 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd24a9e5-a94e-4a21-9c86-a2e63af534f0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:58.574240 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd24a9e5-a94e-4a21-9c86-a2e63af534f0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:58.698895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cd24a9e5-a94e-4a21-9c86-a2e63af534f0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:58.708133 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cd24a9e5-a94e-4a21-9c86-a2e63af534f0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:58.709667 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cd24a9e5-a94e-4a21-9c86-a2e63af534f0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:58.710816 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cd24a9e5-a94e-4a21-9c86-a2e63af534f0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.149219 Jun 02 13:39:58.711368 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 269/564] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:58 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:39:59.458298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cdad2441-8b6d-42ce-afa5-6cb80256d47e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:59.458822 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cdad2441-8b6d-42ce-afa5-6cb80256d47e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:59.465326 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cdad2441-8b6d-42ce-afa5-6cb80256d47e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:59.465778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cdad2441-8b6d-42ce-afa5-6cb80256d47e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:59.466588 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cdad2441-8b6d-42ce-afa5-6cb80256d47e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:59.467031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cdad2441-8b6d-42ce-afa5-6cb80256d47e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:59.598352 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cdad2441-8b6d-42ce-afa5-6cb80256d47e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:59.605835 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cdad2441-8b6d-42ce-afa5-6cb80256d47e tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1445 microversion: 2.1 time: 0.151868 Jun 02 13:39:59.606395 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 296/565] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:59 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:59.622132 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0b835e98-7c59-4755-aff3-0b119331a1c9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:59.622744 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0b835e98-7c59-4755-aff3-0b119331a1c9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:59.629224 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b835e98-7c59-4755-aff3-0b119331a1c9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:59.629674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b835e98-7c59-4755-aff3-0b119331a1c9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:59.630450 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b835e98-7c59-4755-aff3-0b119331a1c9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:59.630883 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b835e98-7c59-4755-aff3-0b119331a1c9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:59.729489 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b36ea44c-49ad-4fa8-ad3e-218f4e51da0a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:39:59.730019 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b36ea44c-49ad-4fa8-ad3e-218f4e51da0a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:39:59.736276 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b36ea44c-49ad-4fa8-ad3e-218f4e51da0a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:59.736763 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b36ea44c-49ad-4fa8-ad3e-218f4e51da0a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:59.737544 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b36ea44c-49ad-4fa8-ad3e-218f4e51da0a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:39:59.737993 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b36ea44c-49ad-4fa8-ad3e-218f4e51da0a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:39:59.760370 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0b835e98-7c59-4755-aff3-0b119331a1c9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:59.768485 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0b835e98-7c59-4755-aff3-0b119331a1c9 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1445 microversion: 2.1 time: 0.150118 Jun 02 13:39:59.769082 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 270/566] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:39:59 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1445 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:39:59.868738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b36ea44c-49ad-4fa8-ad3e-218f4e51da0a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:59.877718 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b36ea44c-49ad-4fa8-ad3e-218f4e51da0a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:59.879334 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b36ea44c-49ad-4fa8-ad3e-218f4e51da0a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:39:59.880499 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b36ea44c-49ad-4fa8-ad3e-218f4e51da0a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.155024 Jun 02 13:39:59.881049 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 297/567] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:39:59 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:40:00.898016 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f0ff1e72-9b42-43bf-991a-c39655caf87d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:00.898736 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f0ff1e72-9b42-43bf-991a-c39655caf87d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:00.905240 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0ff1e72-9b42-43bf-991a-c39655caf87d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:00.905716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0ff1e72-9b42-43bf-991a-c39655caf87d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:00.906450 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0ff1e72-9b42-43bf-991a-c39655caf87d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:00.906881 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0ff1e72-9b42-43bf-991a-c39655caf87d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:01.128509 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f0ff1e72-9b42-43bf-991a-c39655caf87d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:01.137540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f0ff1e72-9b42-43bf-991a-c39655caf87d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:01.139039 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f0ff1e72-9b42-43bf-991a-c39655caf87d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:01.140181 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f0ff1e72-9b42-43bf-991a-c39655caf87d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.246108 Jun 02 13:40:01.140764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 271/568] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:00 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:40:01.583213 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-e9363789-02c3-42a7-aff2-c249ede26327 req-9f25f080-0ad1-466e-8b4a-69fa6afef08d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38561783-c8ae-4094-b4c9-419507739f61", "tag": "f47de7fb-cfb6-4f5f-969c-a30939da7bf0"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:01.592244 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-e9363789-02c3-42a7-aff2-c249ede26327 req-9f25f080-0ad1-466e-8b4a-69fa6afef08d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:01.592755 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-e9363789-02c3-42a7-aff2-c249ede26327 req-9f25f080-0ad1-466e-8b4a-69fa6afef08d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:01.603820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-e9363789-02c3-42a7-aff2-c249ede26327 req-9f25f080-0ad1-466e-8b4a-69fa6afef08d service nova] Creating event network-changed:f47de7fb-cfb6-4f5f-969c-a30939da7bf0 for instance 38561783-c8ae-4094-b4c9-419507739f61 on hv-cinder-83608 Jun 02 13:40:01.608914 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-e9363789-02c3-42a7-aff2-c249ede26327 req-9f25f080-0ad1-466e-8b4a-69fa6afef08d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030092 Jun 02 13:40:01.609507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 298/569] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:40:02.159446 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-237d3359-16d4-4a19-bc90-e61625ebb285 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:02.160209 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-237d3359-16d4-4a19-bc90-e61625ebb285 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:02.167300 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-237d3359-16d4-4a19-bc90-e61625ebb285 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:02.167810 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-237d3359-16d4-4a19-bc90-e61625ebb285 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:02.168673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-237d3359-16d4-4a19-bc90-e61625ebb285 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:02.169110 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-237d3359-16d4-4a19-bc90-e61625ebb285 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:02.307201 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-237d3359-16d4-4a19-bc90-e61625ebb285 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:02.316222 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-237d3359-16d4-4a19-bc90-e61625ebb285 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:02.318215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-237d3359-16d4-4a19-bc90-e61625ebb285 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:02.319680 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-237d3359-16d4-4a19-bc90-e61625ebb285 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.164306 Jun 02 13:40:02.320640 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 272/570] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:02 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:40:03.338995 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-75b037e3-907f-4b09-89a3-9d24c4673129 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:03.339727 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-75b037e3-907f-4b09-89a3-9d24c4673129 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:03.345910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-75b037e3-907f-4b09-89a3-9d24c4673129 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:03.346360 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-75b037e3-907f-4b09-89a3-9d24c4673129 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:03.347121 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-75b037e3-907f-4b09-89a3-9d24c4673129 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:03.347558 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-75b037e3-907f-4b09-89a3-9d24c4673129 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:03.480747 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-75b037e3-907f-4b09-89a3-9d24c4673129 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:03.490175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-75b037e3-907f-4b09-89a3-9d24c4673129 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:03.492217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-75b037e3-907f-4b09-89a3-9d24c4673129 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:03.493423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-75b037e3-907f-4b09-89a3-9d24c4673129 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.159230 Jun 02 13:40:03.493970 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 299/571] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:03 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:40:04.259646 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-15853b69-84c2-43df-b284-19860080b672 req-cab3865e-1aa7-444f-871c-7b2dd669c0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15208f-0bda-407c-8ea0-38a1300bfa16", "name": "network-vif-plugged", "status": "completed", "tag": "8aab5ca9-b3de-4176-a679-2976edeca505"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:04.269357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-15853b69-84c2-43df-b284-19860080b672 req-cab3865e-1aa7-444f-871c-7b2dd669c0f4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:04.269840 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-15853b69-84c2-43df-b284-19860080b672 req-cab3865e-1aa7-444f-871c-7b2dd669c0f4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:04.282213 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-15853b69-84c2-43df-b284-19860080b672 req-cab3865e-1aa7-444f-871c-7b2dd669c0f4 service nova] Creating event network-vif-plugged:8aab5ca9-b3de-4176-a679-2976edeca505 for instance bf15208f-0bda-407c-8ea0-38a1300bfa16 on hv-cinder-83608 Jun 02 13:40:04.287845 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-15853b69-84c2-43df-b284-19860080b672 req-cab3865e-1aa7-444f-871c-7b2dd669c0f4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032221 Jun 02 13:40:04.288803 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 273/572] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:04.514805 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cbfe711e-7304-4383-81e1-1f599c612d95 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:04.515841 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cbfe711e-7304-4383-81e1-1f599c612d95 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:04.520636 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=54 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:04.527281 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbfe711e-7304-4383-81e1-1f599c612d95 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:04.527733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbfe711e-7304-4383-81e1-1f599c612d95 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:04.528529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbfe711e-7304-4383-81e1-1f599c612d95 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:04.528969 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbfe711e-7304-4383-81e1-1f599c612d95 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:04.657604 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cbfe711e-7304-4383-81e1-1f599c612d95 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:04.665961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cbfe711e-7304-4383-81e1-1f599c612d95 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:04.667498 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cbfe711e-7304-4383-81e1-1f599c612d95 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:04.668708 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cbfe711e-7304-4383-81e1-1f599c612d95 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.160176 Jun 02 13:40:04.669260 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 300/573] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:04 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:40:05.687617 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b66b52cf-2521-4a94-80a0-f65f614384cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:05.688329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b66b52cf-2521-4a94-80a0-f65f614384cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:05.695686 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b66b52cf-2521-4a94-80a0-f65f614384cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:05.696130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b66b52cf-2521-4a94-80a0-f65f614384cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:05.696915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b66b52cf-2521-4a94-80a0-f65f614384cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:05.697355 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b66b52cf-2521-4a94-80a0-f65f614384cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:05.825957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b66b52cf-2521-4a94-80a0-f65f614384cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:05.834622 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b66b52cf-2521-4a94-80a0-f65f614384cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:05.836126 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b66b52cf-2521-4a94-80a0-f65f614384cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:05.837316 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b66b52cf-2521-4a94-80a0-f65f614384cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.153946 Jun 02 13:40:05.837873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 274/574] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:05 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:40:06.854835 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-25a11d20-24b3-4838-8ac9-eba99ee4270e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:06.855446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-25a11d20-24b3-4838-8ac9-eba99ee4270e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:06.862068 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25a11d20-24b3-4838-8ac9-eba99ee4270e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:06.862523 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25a11d20-24b3-4838-8ac9-eba99ee4270e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:06.863291 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25a11d20-24b3-4838-8ac9-eba99ee4270e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:06.863734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25a11d20-24b3-4838-8ac9-eba99ee4270e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:06.992530 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-25a11d20-24b3-4838-8ac9-eba99ee4270e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:07.000973 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-25a11d20-24b3-4838-8ac9-eba99ee4270e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:07.003051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-25a11d20-24b3-4838-8ac9-eba99ee4270e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:07.004183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-25a11d20-24b3-4838-8ac9-eba99ee4270e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.153220 Jun 02 13:40:07.004770 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 301/575] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:06 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:40:08.022499 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4d6098c1-d81a-41ab-93d6-5d4ca25e77af tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:08.023107 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4d6098c1-d81a-41ab-93d6-5d4ca25e77af tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:08.029749 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d6098c1-d81a-41ab-93d6-5d4ca25e77af tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:08.030223 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d6098c1-d81a-41ab-93d6-5d4ca25e77af tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:08.030980 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d6098c1-d81a-41ab-93d6-5d4ca25e77af tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:08.031415 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d6098c1-d81a-41ab-93d6-5d4ca25e77af tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:08.157215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4d6098c1-d81a-41ab-93d6-5d4ca25e77af tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:08.165417 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4d6098c1-d81a-41ab-93d6-5d4ca25e77af tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:08.166910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4d6098c1-d81a-41ab-93d6-5d4ca25e77af tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:08.168045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4d6098c1-d81a-41ab-93d6-5d4ca25e77af tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.149402 Jun 02 13:40:08.168633 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 275/576] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:08 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:40:09.185484 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-09a8ed18-0f0a-4af1-9c77-f641fedc3c8f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:09.186029 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-09a8ed18-0f0a-4af1-9c77-f641fedc3c8f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:09.193239 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09a8ed18-0f0a-4af1-9c77-f641fedc3c8f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:09.193693 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09a8ed18-0f0a-4af1-9c77-f641fedc3c8f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:09.194437 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09a8ed18-0f0a-4af1-9c77-f641fedc3c8f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:09.194873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09a8ed18-0f0a-4af1-9c77-f641fedc3c8f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:09.321875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-09a8ed18-0f0a-4af1-9c77-f641fedc3c8f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:09.330627 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-09a8ed18-0f0a-4af1-9c77-f641fedc3c8f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:09.332132 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-09a8ed18-0f0a-4af1-9c77-f641fedc3c8f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:09.333311 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-09a8ed18-0f0a-4af1-9c77-f641fedc3c8f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.151739 Jun 02 13:40:09.333860 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 302/577] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:09 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:40:10.352348 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3a3eafec-6235-40f1-a0cd-7c2ca8e439c0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:10.353007 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3a3eafec-6235-40f1-a0cd-7c2ca8e439c0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:10.359690 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a3eafec-6235-40f1-a0cd-7c2ca8e439c0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:10.360151 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a3eafec-6235-40f1-a0cd-7c2ca8e439c0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:10.360958 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a3eafec-6235-40f1-a0cd-7c2ca8e439c0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:10.361964 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a3eafec-6235-40f1-a0cd-7c2ca8e439c0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:10.490630 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a3eafec-6235-40f1-a0cd-7c2ca8e439c0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:10.499239 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a3eafec-6235-40f1-a0cd-7c2ca8e439c0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:10.500777 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a3eafec-6235-40f1-a0cd-7c2ca8e439c0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:10.501972 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3a3eafec-6235-40f1-a0cd-7c2ca8e439c0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.153532 Jun 02 13:40:10.502528 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 276/578] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:10 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:40:11.520489 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8d3e976e-3019-46ec-b9fd-5257c23d308a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:11.522039 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8d3e976e-3019-46ec-b9fd-5257c23d308a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:11.528593 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8d3e976e-3019-46ec-b9fd-5257c23d308a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:11.529047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8d3e976e-3019-46ec-b9fd-5257c23d308a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:11.529820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8d3e976e-3019-46ec-b9fd-5257c23d308a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:11.530255 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8d3e976e-3019-46ec-b9fd-5257c23d308a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:11.546805 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:11.693367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8d3e976e-3019-46ec-b9fd-5257c23d308a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:11.702834 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8d3e976e-3019-46ec-b9fd-5257c23d308a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:11.717820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8d3e976e-3019-46ec-b9fd-5257c23d308a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:11.719204 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8d3e976e-3019-46ec-b9fd-5257c23d308a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1809 microversion: 2.20 time: 0.203217 Jun 02 13:40:11.719726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 303/579] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:11 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:40:12.737739 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1f5854bb-6bb4-4127-a175-67fecf244826 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:12.738351 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1f5854bb-6bb4-4127-a175-67fecf244826 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:12.744776 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1f5854bb-6bb4-4127-a175-67fecf244826 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:12.745222 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1f5854bb-6bb4-4127-a175-67fecf244826 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:12.745979 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1f5854bb-6bb4-4127-a175-67fecf244826 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:12.746437 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1f5854bb-6bb4-4127-a175-67fecf244826 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:12.876462 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1f5854bb-6bb4-4127-a175-67fecf244826 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:12.884834 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1f5854bb-6bb4-4127-a175-67fecf244826 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:12.886364 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1f5854bb-6bb4-4127-a175-67fecf244826 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:12.887501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1f5854bb-6bb4-4127-a175-67fecf244826 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1796 microversion: 2.20 time: 0.154239 Jun 02 13:40:12.888046 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 277/580] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:40:12 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1796 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:40:33.004393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2b22b0fd-5a70-475a-897e-24a5acc2d3d9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:33.005272 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2b22b0fd-5a70-475a-897e-24a5acc2d3d9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:33.007506 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=7 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:33.008157 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:33.014994 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2b22b0fd-5a70-475a-897e-24a5acc2d3d9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:33.015441 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2b22b0fd-5a70-475a-897e-24a5acc2d3d9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:33.016212 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2b22b0fd-5a70-475a-897e-24a5acc2d3d9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:33.016672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2b22b0fd-5a70-475a-897e-24a5acc2d3d9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:33.087027 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2b22b0fd-5a70-475a-897e-24a5acc2d3d9 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "POST /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/action" status: 202 len: 0 microversion: 2.1 time: 0.086910 Jun 02 13:40:33.087645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 304/581] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:40:32 2022] POST /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:40:33.095649 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c33690da-f7bc-4680-bcec-dbf5765995c7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:33.096259 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c33690da-f7bc-4680-bcec-dbf5765995c7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:33.100958 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=23 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:33.101598 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=55 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:33.106321 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c33690da-f7bc-4680-bcec-dbf5765995c7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:33.106771 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c33690da-f7bc-4680-bcec-dbf5765995c7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:33.107538 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c33690da-f7bc-4680-bcec-dbf5765995c7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:33.108051 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c33690da-f7bc-4680-bcec-dbf5765995c7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:33.258038 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c33690da-f7bc-4680-bcec-dbf5765995c7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:33.265988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c33690da-f7bc-4680-bcec-dbf5765995c7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1751 microversion: 2.1 time: 0.174150 Jun 02 13:40:33.266564 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 278/582] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:33 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:34.285476 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-149b6506-331f-4772-b292-d2d138653893 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:34.286088 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-149b6506-331f-4772-b292-d2d138653893 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:34.292711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-149b6506-331f-4772-b292-d2d138653893 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:34.293163 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-149b6506-331f-4772-b292-d2d138653893 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:34.293953 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-149b6506-331f-4772-b292-d2d138653893 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:34.294386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-149b6506-331f-4772-b292-d2d138653893 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:34.447834 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-149b6506-331f-4772-b292-d2d138653893 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:34.456393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-149b6506-331f-4772-b292-d2d138653893 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.175882 Jun 02 13:40:34.456964 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 305/583] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:34 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:34.809480 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-543998d3-8b2c-4733-9030-2ba65b83df8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:34.810016 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-543998d3-8b2c-4733-9030-2ba65b83df8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:34.816635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-543998d3-8b2c-4733-9030-2ba65b83df8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:34.817076 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-543998d3-8b2c-4733-9030-2ba65b83df8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:34.817825 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-543998d3-8b2c-4733-9030-2ba65b83df8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:34.818256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-543998d3-8b2c-4733-9030-2ba65b83df8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:34.841114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-543998d3-8b2c-4733-9030-2ba65b83df8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec/ips" status: 200 len: 150 microversion: 2.1 time: 0.035588 Jun 02 13:40:34.841660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 279/584] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Jun 2 13:40:34 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:34.852804 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f96fab51-8659-4c7b-97ba-d016dad865bb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cea95873-62fe-4110-aee7-ab5845454f6e"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:34.853958 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f96fab51-8659-4c7b-97ba-d016dad865bb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:34.860052 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f96fab51-8659-4c7b-97ba-d016dad865bb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:34.860551 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f96fab51-8659-4c7b-97ba-d016dad865bb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:34.861348 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f96fab51-8659-4c7b-97ba-d016dad865bb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:34.861790 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f96fab51-8659-4c7b-97ba-d016dad865bb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:34.939098 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-f96fab51-8659-4c7b-97ba-d016dad865bb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Invalid volume: volume cea95873-62fe-4110-aee7-ab5845454f6e is already attached to instances: 123ffac0-b1c6-4d56-a959-9dddf4e649c3 Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f96fab51-8659-4c7b-97ba-d016dad865bb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: POST /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec/os-volume_attachments HTTP/1.1 Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 74 Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:40:34.940879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {"volumeAttachment": {"volumeId": "cea95873-62fe-4110-aee7-ab5845454f6e"}} Jun 02 13:40:34.942457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Invalid volume: volume cea95873-62fe-4110-aee7-ab5845454f6e is already attached to instances: 123ffac0-b1c6-4d56-a959-9dddf4e649c3 Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'server_id': '955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec', 'body': {'volumeAttachment': {'volumeId': 'cea95873-62fe-4110-aee7-ab5845454f6e'}}} Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cea95873-62fe-4110-aee7-ab5845454f6e is already attached to instances: 123ffac0-b1c6-4d56-a959-9dddf4e649c3 Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:34.943356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cea95873-62fe-4110-aee7-ab5845454f6e is already attached to instances: 123ffac0-b1c6-4d56-a959-9dddf4e649c3 Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:34.944750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:34.946031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:34.946031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:34.946031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:34.946031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cea95873-62fe-4110-aee7-ab5845454f6e is already attached to instances: 123ffac0-b1c6-4d56-a959-9dddf4e649c3 Jun 02 13:40:34.946031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:34.946031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f96fab51-8659-4c7b-97ba-d016dad865bb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 400 to user: Invalid volume: volume cea95873-62fe-4110-aee7-ab5845454f6e is already attached to instances: 123ffac0-b1c6-4d56-a959-9dddf4e649c3 {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:34.946031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f96fab51-8659-4c7b-97ba-d016dad865bb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093604 Jun 02 13:40:34.946031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 306/585] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:40:34 2022] POST /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:40:34.951559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b3bd5862-7ce1-4ba1-b285-2c6943d013cb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:34.952058 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b3bd5862-7ce1-4ba1-b285-2c6943d013cb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:34.958962 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3bd5862-7ce1-4ba1-b285-2c6943d013cb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:34.959402 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3bd5862-7ce1-4ba1-b285-2c6943d013cb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:34.960154 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3bd5862-7ce1-4ba1-b285-2c6943d013cb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:34.960608 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3bd5862-7ce1-4ba1-b285-2c6943d013cb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:34.984776 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b3bd5862-7ce1-4ba1-b285-2c6943d013cb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:40:35.057273 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b3bd5862-7ce1-4ba1-b285-2c6943d013cb tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 204 len: 0 microversion: 2.1 time: 0.109338 Jun 02 13:40:35.057863 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 280/586] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:40:34 2022] DELETE /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:40:35.066680 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-83fdaee6-0023-4dec-90b3-b8355ffa637f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:35.067226 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-83fdaee6-0023-4dec-90b3-b8355ffa637f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:35.073945 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83fdaee6-0023-4dec-90b3-b8355ffa637f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:35.074398 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83fdaee6-0023-4dec-90b3-b8355ffa637f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:35.075171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83fdaee6-0023-4dec-90b3-b8355ffa637f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:35.075610 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83fdaee6-0023-4dec-90b3-b8355ffa637f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:35.202425 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-83fdaee6-0023-4dec-90b3-b8355ffa637f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:35.210595 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-83fdaee6-0023-4dec-90b3-b8355ffa637f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1680 microversion: 2.1 time: 0.148462 Jun 02 13:40:35.211155 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 307/587] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:35 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:35.473885 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-37ee901e-986e-405d-b75d-ba76996fb2e3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:35.474510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-37ee901e-986e-405d-b75d-ba76996fb2e3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:35.480447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37ee901e-986e-405d-b75d-ba76996fb2e3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:35.480889 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37ee901e-986e-405d-b75d-ba76996fb2e3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:35.481642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37ee901e-986e-405d-b75d-ba76996fb2e3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:35.482074 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37ee901e-986e-405d-b75d-ba76996fb2e3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:35.625547 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-37ee901e-986e-405d-b75d-ba76996fb2e3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:35.633677 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-37ee901e-986e-405d-b75d-ba76996fb2e3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.164361 Jun 02 13:40:35.634248 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 281/588] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:35 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:36.228165 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2cc9e0da-bdda-429c-9f56-9e2f0b8cecc1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:36.228815 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2cc9e0da-bdda-429c-9f56-9e2f0b8cecc1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:36.235335 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cc9e0da-bdda-429c-9f56-9e2f0b8cecc1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:36.236349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cc9e0da-bdda-429c-9f56-9e2f0b8cecc1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:36.237115 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cc9e0da-bdda-429c-9f56-9e2f0b8cecc1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:36.237554 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cc9e0da-bdda-429c-9f56-9e2f0b8cecc1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:36.361548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2cc9e0da-bdda-429c-9f56-9e2f0b8cecc1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:36.369043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2cc9e0da-bdda-429c-9f56-9e2f0b8cecc1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1680 microversion: 2.1 time: 0.144731 Jun 02 13:40:36.369603 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 308/589] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:36 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:36.651227 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-58e199db-2119-4504-bb26-e4ec5a8fe9fb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:36.651769 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-58e199db-2119-4504-bb26-e4ec5a8fe9fb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:36.658712 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58e199db-2119-4504-bb26-e4ec5a8fe9fb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:36.659160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58e199db-2119-4504-bb26-e4ec5a8fe9fb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:36.659918 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58e199db-2119-4504-bb26-e4ec5a8fe9fb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:36.660386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58e199db-2119-4504-bb26-e4ec5a8fe9fb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:36.800564 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-58e199db-2119-4504-bb26-e4ec5a8fe9fb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:36.808472 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-58e199db-2119-4504-bb26-e4ec5a8fe9fb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.161105 Jun 02 13:40:36.809024 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 282/590] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:36 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:37.387944 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6a3aa2f9-cf3d-4906-91bc-736ad237ae42 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:37.388597 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6a3aa2f9-cf3d-4906-91bc-736ad237ae42 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:37.395609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6a3aa2f9-cf3d-4906-91bc-736ad237ae42 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:37.396068 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6a3aa2f9-cf3d-4906-91bc-736ad237ae42 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:37.396873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6a3aa2f9-cf3d-4906-91bc-736ad237ae42 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:37.397318 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6a3aa2f9-cf3d-4906-91bc-736ad237ae42 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:37.522844 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6a3aa2f9-cf3d-4906-91bc-736ad237ae42 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:37.530284 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6a3aa2f9-cf3d-4906-91bc-736ad237ae42 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1680 microversion: 2.1 time: 0.146202 Jun 02 13:40:37.530848 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 309/591] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:37 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:37.826385 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-663b5976-589e-41b8-926e-f2a8995f1b0f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:37.827087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-663b5976-589e-41b8-926e-f2a8995f1b0f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:37.833807 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-663b5976-589e-41b8-926e-f2a8995f1b0f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:37.834384 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-663b5976-589e-41b8-926e-f2a8995f1b0f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:37.835159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-663b5976-589e-41b8-926e-f2a8995f1b0f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:37.835602 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-663b5976-589e-41b8-926e-f2a8995f1b0f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:37.982481 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-663b5976-589e-41b8-926e-f2a8995f1b0f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:37.991203 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-663b5976-589e-41b8-926e-f2a8995f1b0f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.169263 Jun 02 13:40:37.991781 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 283/592] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:37 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:38.494472 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-d0851777-6d9d-4dd9-8438-c6d7ac14122f req-6c823232-1b6e-478c-bd9e-76e232240529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec", "name": "network-vif-deleted", "tag": "94186e6c-fc85-41ca-ae77-bd755f5fceed"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:38.504148 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-d0851777-6d9d-4dd9-8438-c6d7ac14122f req-6c823232-1b6e-478c-bd9e-76e232240529 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:38.504148 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-d0851777-6d9d-4dd9-8438-c6d7ac14122f req-6c823232-1b6e-478c-bd9e-76e232240529 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:38.515681 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-d0851777-6d9d-4dd9-8438-c6d7ac14122f req-6c823232-1b6e-478c-bd9e-76e232240529 service nova] Creating event network-vif-deleted:94186e6c-fc85-41ca-ae77-bd755f5fceed for instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec on hv-cinder-83608 Jun 02 13:40:38.521053 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-d0851777-6d9d-4dd9-8438-c6d7ac14122f req-6c823232-1b6e-478c-bd9e-76e232240529 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030232 Jun 02 13:40:38.521938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 310/593] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:38.547328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bcc83e0f-6d09-42fc-9952-55879efb26f0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:38.547963 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bcc83e0f-6d09-42fc-9952-55879efb26f0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:38.554041 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bcc83e0f-6d09-42fc-9952-55879efb26f0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:38.554491 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bcc83e0f-6d09-42fc-9952-55879efb26f0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:38.555261 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bcc83e0f-6d09-42fc-9952-55879efb26f0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:38.555694 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bcc83e0f-6d09-42fc-9952-55879efb26f0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:38.637468 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bcc83e0f-6d09-42fc-9952-55879efb26f0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:38.645205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bcc83e0f-6d09-42fc-9952-55879efb26f0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 200 len: 1325 microversion: 2.1 time: 0.101745 Jun 02 13:40:38.645976 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 284/594] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:38 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 1325 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:39.010631 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3f529b29-a130-4774-a060-5b909cdfdddb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:39.012345 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3f529b29-a130-4774-a060-5b909cdfdddb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:39.021365 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f529b29-a130-4774-a060-5b909cdfdddb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:39.021855 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f529b29-a130-4774-a060-5b909cdfdddb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:39.022632 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f529b29-a130-4774-a060-5b909cdfdddb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:39.023074 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f529b29-a130-4774-a060-5b909cdfdddb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:39.170078 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3f529b29-a130-4774-a060-5b909cdfdddb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:39.179085 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3f529b29-a130-4774-a060-5b909cdfdddb tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.174378 Jun 02 13:40:39.179645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 311/595] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:39 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:39.405990 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a7ec8009-47bb-479b-87b2-f0382757d981 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98deeac9-760c-487f-bfc3-08b411e07fbd"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:39.407402 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a7ec8009-47bb-479b-87b2-f0382757d981 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:39.416602 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7ec8009-47bb-479b-87b2-f0382757d981 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:39.416868 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7ec8009-47bb-479b-87b2-f0382757d981 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:39.417691 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7ec8009-47bb-479b-87b2-f0382757d981 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:39.418161 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7ec8009-47bb-479b-87b2-f0382757d981 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:39.665664 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e9b1484b-d737-439a-8604-1431d1c62024 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:39.666272 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e9b1484b-d737-439a-8604-1431d1c62024 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:39.673919 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9b1484b-d737-439a-8604-1431d1c62024 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:39.674428 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9b1484b-d737-439a-8604-1431d1c62024 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:39.675616 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9b1484b-d737-439a-8604-1431d1c62024 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:39.676060 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9b1484b-d737-439a-8604-1431d1c62024 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:39.691257 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-e9b1484b-d737-439a-8604-1431d1c62024 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e9b1484b-d737-439a-8604-1431d1c62024 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec HTTP/1.1 Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:40:39.693429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:40:39.694941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec'} Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:39.695810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:40:39.697380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:39.698787 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e9b1484b-d737-439a-8604-1431d1c62024 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:39.698787 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e9b1484b-d737-439a-8604-1431d1c62024 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 404 len: 111 microversion: 2.1 time: 0.036403 Jun 02 13:40:39.699339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 312/596] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:39 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:40:39.704877 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bf4a69ee-3515-4b60-aed1-179adf809d16 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '.version_select at 0x7f8614e5f940>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:39.725038 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bf4a69ee-3515-4b60-aed1-179adf809d16 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890763141" status: 202 len: 0 microversion: 2.1 time: 0.024587 Jun 02 13:40:39.725658 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 313/597] 10.222.0.32 () {58 vars in 1217 bytes} [Thu Jun 2 13:40:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890763141 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:40:39.757288 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a7ec8009-47bb-479b-87b2-f0382757d981 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356643 Jun 02 13:40:39.757914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 285/598] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:40:39 2022] POST /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:40.196160 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-849b2207-b1d8-4784-8bdd-52ea2f7d0a73 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:40.196887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-849b2207-b1d8-4784-8bdd-52ea2f7d0a73 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:40.203873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-849b2207-b1d8-4784-8bdd-52ea2f7d0a73 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:40.205075 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-849b2207-b1d8-4784-8bdd-52ea2f7d0a73 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:40.205849 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-849b2207-b1d8-4784-8bdd-52ea2f7d0a73 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:40.206483 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-849b2207-b1d8-4784-8bdd-52ea2f7d0a73 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:40.392778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-849b2207-b1d8-4784-8bdd-52ea2f7d0a73 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:40.402305 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-849b2207-b1d8-4784-8bdd-52ea2f7d0a73 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.209952 Jun 02 13:40:40.403463 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 314/599] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:40 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:40.439175 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b72f4488-5b58-450e-9fec-dce2ef180515 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:40.439757 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b72f4488-5b58-450e-9fec-dce2ef180515 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:40.446070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b72f4488-5b58-450e-9fec-dce2ef180515 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:40.446568 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b72f4488-5b58-450e-9fec-dce2ef180515 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:40.447275 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b72f4488-5b58-450e-9fec-dce2ef180515 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:40.447708 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b72f4488-5b58-450e-9fec-dce2ef180515 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:40.574704 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-b72f4488-5b58-450e-9fec-dce2ef180515 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lazy-loading 'services' on Instance uuid 123ffac0-b1c6-4d56-a959-9dddf4e649c3 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:40:40.690809 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b72f4488-5b58-450e-9fec-dce2ef180515 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments/cea95873-62fe-4110-aee7-ab5845454f6e" status: 202 len: 0 microversion: 2.1 time: 0.256906 Jun 02 13:40:40.691466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 286/600] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:40:40 2022] DELETE /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments/cea95873-62fe-4110-aee7-ab5845454f6e => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:40:40.700653 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-854b7963-e6eb-4913-98e2-d8eaa909454b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:40.701689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-854b7963-e6eb-4913-98e2-d8eaa909454b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:40.710383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-854b7963-e6eb-4913-98e2-d8eaa909454b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:40.711096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-854b7963-e6eb-4913-98e2-d8eaa909454b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:40.712156 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-854b7963-e6eb-4913-98e2-d8eaa909454b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:40.712699 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-854b7963-e6eb-4913-98e2-d8eaa909454b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:40.757080 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-854b7963-e6eb-4913-98e2-d8eaa909454b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061063 Jun 02 13:40:40.757778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 315/601] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:40 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:41.421674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2d9ab241-d1d2-44f7-b754-0e0ed58aa341 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:41.422405 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2d9ab241-d1d2-44f7-b754-0e0ed58aa341 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:41.430578 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d9ab241-d1d2-44f7-b754-0e0ed58aa341 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:41.431195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d9ab241-d1d2-44f7-b754-0e0ed58aa341 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:41.432420 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d9ab241-d1d2-44f7-b754-0e0ed58aa341 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:41.432919 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d9ab241-d1d2-44f7-b754-0e0ed58aa341 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:41.580479 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2d9ab241-d1d2-44f7-b754-0e0ed58aa341 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:41.588416 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2d9ab241-d1d2-44f7-b754-0e0ed58aa341 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.173062 Jun 02 13:40:41.589222 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 287/602] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:41 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:41.769421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ff51f573-70be-4045-96b8-7152faa25cee tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:41.770240 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ff51f573-70be-4045-96b8-7152faa25cee tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:41.776971 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff51f573-70be-4045-96b8-7152faa25cee tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:41.777423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff51f573-70be-4045-96b8-7152faa25cee tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:41.778192 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff51f573-70be-4045-96b8-7152faa25cee tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:41.778638 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff51f573-70be-4045-96b8-7152faa25cee tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:41.810470 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ff51f573-70be-4045-96b8-7152faa25cee tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Jun 02 13:40:41.811013 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 316/603] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:41 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:42.605330 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-278fba79-2c25-4b61-81c5-af9855b57d1f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:42.605940 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-278fba79-2c25-4b61-81c5-af9855b57d1f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:42.613045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-278fba79-2c25-4b61-81c5-af9855b57d1f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:42.613491 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-278fba79-2c25-4b61-81c5-af9855b57d1f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:42.614242 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-278fba79-2c25-4b61-81c5-af9855b57d1f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:42.614675 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-278fba79-2c25-4b61-81c5-af9855b57d1f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:42.752420 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-278fba79-2c25-4b61-81c5-af9855b57d1f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:42.760504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-278fba79-2c25-4b61-81c5-af9855b57d1f tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.158946 Jun 02 13:40:42.761230 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 288/604] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:42 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:42.821891 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f69dd512-8abe-40b8-9161-d8af99505025 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:42.822793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f69dd512-8abe-40b8-9161-d8af99505025 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:42.829405 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f69dd512-8abe-40b8-9161-d8af99505025 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:42.829845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f69dd512-8abe-40b8-9161-d8af99505025 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:42.830598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f69dd512-8abe-40b8-9161-d8af99505025 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:42.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f69dd512-8abe-40b8-9161-d8af99505025 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:42.859077 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f69dd512-8abe-40b8-9161-d8af99505025 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041156 Jun 02 13:40:42.859604 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 317/605] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:42 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:43.777695 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6db52a16-8a00-4a18-ac97-8c098faceb48 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:43.778214 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6db52a16-8a00-4a18-ac97-8c098faceb48 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:43.784922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6db52a16-8a00-4a18-ac97-8c098faceb48 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:43.785372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6db52a16-8a00-4a18-ac97-8c098faceb48 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:43.786130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6db52a16-8a00-4a18-ac97-8c098faceb48 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:43.786567 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6db52a16-8a00-4a18-ac97-8c098faceb48 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:43.870942 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b95f7fe7-1f59-4148-b6b1-12b5b517d51d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:43.871888 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b95f7fe7-1f59-4148-b6b1-12b5b517d51d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:43.879005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b95f7fe7-1f59-4148-b6b1-12b5b517d51d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:43.879477 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b95f7fe7-1f59-4148-b6b1-12b5b517d51d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:43.880238 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b95f7fe7-1f59-4148-b6b1-12b5b517d51d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:43.881295 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b95f7fe7-1f59-4148-b6b1-12b5b517d51d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:43.910142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b95f7fe7-1f59-4148-b6b1-12b5b517d51d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043004 Jun 02 13:40:43.910707 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 318/606] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:43 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:40:43.929178 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6db52a16-8a00-4a18-ac97-8c098faceb48 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:43.937022 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6db52a16-8a00-4a18-ac97-8c098faceb48 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.163310 Jun 02 13:40:43.937579 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 289/607] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:43 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:40:44.185156 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3b4e8e7f-d906-428b-b6ca-360c25fbf8e3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:44.185647 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3b4e8e7f-d906-428b-b6ca-360c25fbf8e3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:44.191612 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3b4e8e7f-d906-428b-b6ca-360c25fbf8e3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:44.192051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3b4e8e7f-d906-428b-b6ca-360c25fbf8e3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:44.192843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3b4e8e7f-d906-428b-b6ca-360c25fbf8e3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:44.193273 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3b4e8e7f-d906-428b-b6ca-360c25fbf8e3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:44.311597 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-3b4e8e7f-d906-428b-b6ca-360c25fbf8e3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lazy-loading 'services' on Instance uuid 50ef14f4-ad83-4f47-bcf7-cd051e84dcef {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:40:44.421331 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3b4e8e7f-d906-428b-b6ca-360c25fbf8e3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "DELETE /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/os-volume_attachments/759e7466-8430-455e-a02d-55bd0656186b" status: 202 len: 0 microversion: 2.1 time: 0.239865 Jun 02 13:40:44.421999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 319/608] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:40:44 2022] DELETE /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/os-volume_attachments/759e7466-8430-455e-a02d-55bd0656186b => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:40:44.922638 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4d419fa0-73a4-433a-bffe-6b260cc7bdd0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:44.923533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4d419fa0-73a4-433a-bffe-6b260cc7bdd0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:44.930128 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d419fa0-73a4-433a-bffe-6b260cc7bdd0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:44.930580 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d419fa0-73a4-433a-bffe-6b260cc7bdd0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:44.931339 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d419fa0-73a4-433a-bffe-6b260cc7bdd0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:44.931774 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d419fa0-73a4-433a-bffe-6b260cc7bdd0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:44.956392 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bfb675ca-1ee3-4b39-8270-82574ddda6d6 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:44.957104 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bfb675ca-1ee3-4b39-8270-82574ddda6d6 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:44.962272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4d419fa0-73a4-433a-bffe-6b260cc7bdd0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044414 Jun 02 13:40:44.963042 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 290/609] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:44 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:44.963464 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfb675ca-1ee3-4b39-8270-82574ddda6d6 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:44.963992 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfb675ca-1ee3-4b39-8270-82574ddda6d6 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:44.964803 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfb675ca-1ee3-4b39-8270-82574ddda6d6 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:44.965248 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfb675ca-1ee3-4b39-8270-82574ddda6d6 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:45.107455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bfb675ca-1ee3-4b39-8270-82574ddda6d6 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:45.115491 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bfb675ca-1ee3-4b39-8270-82574ddda6d6 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.164621 Jun 02 13:40:45.116049 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 320/610] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:44 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:40:45.974417 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c633b3f1-4643-4c1d-adf4-78ff200bda89 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:45.975369 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c633b3f1-4643-4c1d-adf4-78ff200bda89 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:45.981842 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c633b3f1-4643-4c1d-adf4-78ff200bda89 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:45.982290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c633b3f1-4643-4c1d-adf4-78ff200bda89 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:45.983040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c633b3f1-4643-4c1d-adf4-78ff200bda89 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:45.983478 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c633b3f1-4643-4c1d-adf4-78ff200bda89 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:45.987172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:46.016886 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c633b3f1-4643-4c1d-adf4-78ff200bda89 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046334 Jun 02 13:40:46.017459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 291/611] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:45 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:46.131646 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-622589dc-b8e4-455b-bf6c-2085ff64728a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:46.132421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-622589dc-b8e4-455b-bf6c-2085ff64728a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:46.138811 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-622589dc-b8e4-455b-bf6c-2085ff64728a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:46.139255 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-622589dc-b8e4-455b-bf6c-2085ff64728a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:46.140016 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-622589dc-b8e4-455b-bf6c-2085ff64728a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:46.140496 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-622589dc-b8e4-455b-bf6c-2085ff64728a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:46.145098 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:46.447002 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-622589dc-b8e4-455b-bf6c-2085ff64728a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:46.455745 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-622589dc-b8e4-455b-bf6c-2085ff64728a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.327939 Jun 02 13:40:46.456317 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 321/612] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:46 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:47.028164 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6d162f0b-b848-4c3d-bfd0-1eb95a2fc0ae tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:47.029121 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6d162f0b-b848-4c3d-bfd0-1eb95a2fc0ae tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:47.035479 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6d162f0b-b848-4c3d-bfd0-1eb95a2fc0ae tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:47.035930 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6d162f0b-b848-4c3d-bfd0-1eb95a2fc0ae tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:47.036741 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6d162f0b-b848-4c3d-bfd0-1eb95a2fc0ae tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:47.037199 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6d162f0b-b848-4c3d-bfd0-1eb95a2fc0ae tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:47.068496 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6d162f0b-b848-4c3d-bfd0-1eb95a2fc0ae tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 Jun 02 13:40:47.069050 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 292/613] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:47 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:47.252248 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-27e22ada-0f64-4588-b789-77b524c357c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:47.253299 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-27e22ada-0f64-4588-b789-77b524c357c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:47.259668 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-27e22ada-0f64-4588-b789-77b524c357c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:47.260051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-27e22ada-0f64-4588-b789-77b524c357c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:47.260864 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-27e22ada-0f64-4588-b789-77b524c357c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:47.261296 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-27e22ada-0f64-4588-b789-77b524c357c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:47.283718 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-27e22ada-0f64-4588-b789-77b524c357c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lazy-loading 'flavor' on Instance uuid 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:40:47.399573 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-27e22ada-0f64-4588-b789-77b524c357c0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/action" status: 200 len: 32 microversion: 2.1 time: 0.151205 Jun 02 13:40:47.400166 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 322/614] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:40:47 2022] POST /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:40:47.409889 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4b03c9c6-264d-46f2-9cf6-ff04ae4e5b81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:47.410513 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4b03c9c6-264d-46f2-9cf6-ff04ae4e5b81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:47.416504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b03c9c6-264d-46f2-9cf6-ff04ae4e5b81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:47.416962 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b03c9c6-264d-46f2-9cf6-ff04ae4e5b81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:47.417728 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b03c9c6-264d-46f2-9cf6-ff04ae4e5b81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:47.418171 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b03c9c6-264d-46f2-9cf6-ff04ae4e5b81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:47.475035 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-61e4c663-4310-412e-9ff5-d86b29b56c08 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:47.475743 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-61e4c663-4310-412e-9ff5-d86b29b56c08 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:47.482039 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61e4c663-4310-412e-9ff5-d86b29b56c08 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:47.482502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61e4c663-4310-412e-9ff5-d86b29b56c08 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:47.483279 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61e4c663-4310-412e-9ff5-d86b29b56c08 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:47.483727 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-61e4c663-4310-412e-9ff5-d86b29b56c08 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:47.597224 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4b03c9c6-264d-46f2-9cf6-ff04ae4e5b81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:47.606598 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4b03c9c6-264d-46f2-9cf6-ff04ae4e5b81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.201138 Jun 02 13:40:47.607701 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 293/615] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:47 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:47.662219 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-61e4c663-4310-412e-9ff5-d86b29b56c08 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:47.670653 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-61e4c663-4310-412e-9ff5-d86b29b56c08 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.199833 Jun 02 13:40:47.671225 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 323/616] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:47 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:48.080686 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1d48c448-04b8-485f-81d2-bd34935f8011 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:48.081628 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1d48c448-04b8-485f-81d2-bd34935f8011 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:48.088547 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d48c448-04b8-485f-81d2-bd34935f8011 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:48.089119 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d48c448-04b8-485f-81d2-bd34935f8011 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:48.089966 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d48c448-04b8-485f-81d2-bd34935f8011 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:48.090436 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d48c448-04b8-485f-81d2-bd34935f8011 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:48.120976 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1d48c448-04b8-485f-81d2-bd34935f8011 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Jun 02 13:40:48.121657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 294/617] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:48 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:48.624018 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2cb6c784-6271-4bae-92f6-1bd1e968e147 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:48.624659 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2cb6c784-6271-4bae-92f6-1bd1e968e147 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:48.631703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cb6c784-6271-4bae-92f6-1bd1e968e147 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:48.632141 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cb6c784-6271-4bae-92f6-1bd1e968e147 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:48.632935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cb6c784-6271-4bae-92f6-1bd1e968e147 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:48.633372 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cb6c784-6271-4bae-92f6-1bd1e968e147 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:48.688999 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2132e189-a03e-4517-8e9d-803744b120a8 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:48.689953 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2132e189-a03e-4517-8e9d-803744b120a8 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:48.700981 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2132e189-a03e-4517-8e9d-803744b120a8 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:48.701510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2132e189-a03e-4517-8e9d-803744b120a8 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:48.702383 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2132e189-a03e-4517-8e9d-803744b120a8 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:48.703027 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2132e189-a03e-4517-8e9d-803744b120a8 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:48.813856 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2cb6c784-6271-4bae-92f6-1bd1e968e147 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:48.822569 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2cb6c784-6271-4bae-92f6-1bd1e968e147 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.202323 Jun 02 13:40:48.823370 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 324/618] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:48 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:40:48.871949 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2132e189-a03e-4517-8e9d-803744b120a8 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:48.880398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2132e189-a03e-4517-8e9d-803744b120a8 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.196151 Jun 02 13:40:48.880963 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 295/619] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:48 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:49.132439 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d63e003d-ccfd-4594-8b7c-6c71d81c2380 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:49.133367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d63e003d-ccfd-4594-8b7c-6c71d81c2380 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:49.139604 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d63e003d-ccfd-4594-8b7c-6c71d81c2380 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.140074 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d63e003d-ccfd-4594-8b7c-6c71d81c2380 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:49.140877 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d63e003d-ccfd-4594-8b7c-6c71d81c2380 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.141830 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d63e003d-ccfd-4594-8b7c-6c71d81c2380 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:49.171370 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d63e003d-ccfd-4594-8b7c-6c71d81c2380 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043071 Jun 02 13:40:49.171930 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 325/620] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:40:49 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:40:49.229322 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-55aab0ad-b3ed-46f6-95fe-85dde5deaf12 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:49.229905 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-55aab0ad-b3ed-46f6-95fe-85dde5deaf12 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:49.236385 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55aab0ad-b3ed-46f6-95fe-85dde5deaf12 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.236836 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55aab0ad-b3ed-46f6-95fe-85dde5deaf12 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:49.237596 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55aab0ad-b3ed-46f6-95fe-85dde5deaf12 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.238032 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55aab0ad-b3ed-46f6-95fe-85dde5deaf12 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:49.262572 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-55aab0ad-b3ed-46f6-95fe-85dde5deaf12 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:40:49.334130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-55aab0ad-b3ed-46f6-95fe-85dde5deaf12 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 204 len: 0 microversion: 2.1 time: 0.108835 Jun 02 13:40:49.334708 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 296/621] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:40:49 2022] DELETE /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:40:49.342665 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b96d802b-fab1-4b0f-9670-9cf110254c94 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:49.343292 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b96d802b-fab1-4b0f-9670-9cf110254c94 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:49.349893 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b96d802b-fab1-4b0f-9670-9cf110254c94 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.350352 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b96d802b-fab1-4b0f-9670-9cf110254c94 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:49.351123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b96d802b-fab1-4b0f-9670-9cf110254c94 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.351569 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b96d802b-fab1-4b0f-9670-9cf110254c94 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:49.482876 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b96d802b-fab1-4b0f-9670-9cf110254c94 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:49.490621 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b96d802b-fab1-4b0f-9670-9cf110254c94 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1682 microversion: 2.1 time: 0.151713 Jun 02 13:40:49.491178 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 326/622] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:49 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:49.781978 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-71bfee64-1545-4336-8a50-172837aae605 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:49.788050 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-71bfee64-1545-4336-8a50-172837aae605 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.788538 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-71bfee64-1545-4336-8a50-172837aae605 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:49.810099 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-71bfee64-1545-4336-8a50-172837aae605 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Going to try to stop instance {{(pid=124122) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 13:40:49.840818 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7397b806-3f33-4252-803e-a28966d16dfa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:49.841426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7397b806-3f33-4252-803e-a28966d16dfa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:49.848435 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7397b806-3f33-4252-803e-a28966d16dfa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.848891 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7397b806-3f33-4252-803e-a28966d16dfa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:49.849655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7397b806-3f33-4252-803e-a28966d16dfa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.850174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7397b806-3f33-4252-803e-a28966d16dfa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:49.851108 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-71bfee64-1545-4336-8a50-172837aae605 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/action" status: 202 len: 0 microversion: 2.1 time: 0.073176 Jun 02 13:40:49.851703 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 297/623] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:40:49 2022] POST /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:40:49.859805 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-64f86ba7-8fd7-4e2f-bf25-4229dcdc0d0b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:49.861089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-64f86ba7-8fd7-4e2f-bf25-4229dcdc0d0b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:49.867127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-64f86ba7-8fd7-4e2f-bf25-4229dcdc0d0b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.867581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-64f86ba7-8fd7-4e2f-bf25-4229dcdc0d0b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:49.868375 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-64f86ba7-8fd7-4e2f-bf25-4229dcdc0d0b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:49.868813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-64f86ba7-8fd7-4e2f-bf25-4229dcdc0d0b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:50.048153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7397b806-3f33-4252-803e-a28966d16dfa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:50.051917 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-64f86ba7-8fd7-4e2f-bf25-4229dcdc0d0b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:50.056349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7397b806-3f33-4252-803e-a28966d16dfa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.219604 Jun 02 13:40:50.056919 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 327/624] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:49 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:50.060369 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-64f86ba7-8fd7-4e2f-bf25-4229dcdc0d0b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.204457 Jun 02 13:40:50.061189 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 298/625] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:49 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:40:50.061306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-538e24d4-c286-47e0-89e7-0d5a84d4e555 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:50.061818 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-538e24d4-c286-47e0-89e7-0d5a84d4e555 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:50.068056 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-538e24d4-c286-47e0-89e7-0d5a84d4e555 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:50.068534 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-538e24d4-c286-47e0-89e7-0d5a84d4e555 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:50.069295 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-538e24d4-c286-47e0-89e7-0d5a84d4e555 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:50.069729 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-538e24d4-c286-47e0-89e7-0d5a84d4e555 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:50.205750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-538e24d4-c286-47e0-89e7-0d5a84d4e555 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:50.213580 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-538e24d4-c286-47e0-89e7-0d5a84d4e555 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.155737 Jun 02 13:40:50.214135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 328/626] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:50 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:50.507585 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-84335cc4-5415-4b16-a56e-bcc2d0d1d572 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:50.508195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-84335cc4-5415-4b16-a56e-bcc2d0d1d572 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:50.514715 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84335cc4-5415-4b16-a56e-bcc2d0d1d572 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:50.515158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84335cc4-5415-4b16-a56e-bcc2d0d1d572 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:50.516796 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84335cc4-5415-4b16-a56e-bcc2d0d1d572 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:50.517235 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84335cc4-5415-4b16-a56e-bcc2d0d1d572 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:50.644819 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-84335cc4-5415-4b16-a56e-bcc2d0d1d572 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:50.652419 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-84335cc4-5415-4b16-a56e-bcc2d0d1d572 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1682 microversion: 2.1 time: 0.148649 Jun 02 13:40:50.652921 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 299/627] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:50 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:51.073769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5b8ee7c7-c825-48b9-b2e0-5f9cae321a81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:51.074379 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5b8ee7c7-c825-48b9-b2e0-5f9cae321a81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:51.078613 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ba88f0f4-a658-4fd7-8e65-d8bd1d411791 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:51.079861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ba88f0f4-a658-4fd7-8e65-d8bd1d411791 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:51.081843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5b8ee7c7-c825-48b9-b2e0-5f9cae321a81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:51.082298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5b8ee7c7-c825-48b9-b2e0-5f9cae321a81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:51.083066 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5b8ee7c7-c825-48b9-b2e0-5f9cae321a81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:51.083504 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5b8ee7c7-c825-48b9-b2e0-5f9cae321a81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:51.085768 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba88f0f4-a658-4fd7-8e65-d8bd1d411791 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:51.086222 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba88f0f4-a658-4fd7-8e65-d8bd1d411791 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:51.086990 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba88f0f4-a658-4fd7-8e65-d8bd1d411791 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:51.087421 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba88f0f4-a658-4fd7-8e65-d8bd1d411791 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:51.266263 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5b8ee7c7-c825-48b9-b2e0-5f9cae321a81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:51.274242 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5b8ee7c7-c825-48b9-b2e0-5f9cae321a81 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.204353 Jun 02 13:40:51.274785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 329/628] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:51 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:51.276721 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ba88f0f4-a658-4fd7-8e65-d8bd1d411791 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:51.279164 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e80354e5-597a-426e-9f5c-ebee805c5a63 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:51.279920 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e80354e5-597a-426e-9f5c-ebee805c5a63 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:51.284951 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ba88f0f4-a658-4fd7-8e65-d8bd1d411791 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1724 microversion: 2.1 time: 0.210500 Jun 02 13:40:51.285522 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 300/629] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:51 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:40:51.285654 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e80354e5-597a-426e-9f5c-ebee805c5a63 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:51.285965 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e80354e5-597a-426e-9f5c-ebee805c5a63 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:51.286722 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e80354e5-597a-426e-9f5c-ebee805c5a63 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:51.287157 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e80354e5-597a-426e-9f5c-ebee805c5a63 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:51.424686 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e80354e5-597a-426e-9f5c-ebee805c5a63 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:51.432882 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e80354e5-597a-426e-9f5c-ebee805c5a63 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1756 microversion: 2.1 time: 0.157131 Jun 02 13:40:51.433447 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 330/630] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:51 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:51.669352 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-72c1a357-23e0-4ddd-a3ab-86c3456dd3ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:51.669994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-72c1a357-23e0-4ddd-a3ab-86c3456dd3ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:51.677216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72c1a357-23e0-4ddd-a3ab-86c3456dd3ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:51.677663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72c1a357-23e0-4ddd-a3ab-86c3456dd3ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:51.678455 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72c1a357-23e0-4ddd-a3ab-86c3456dd3ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:51.678891 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72c1a357-23e0-4ddd-a3ab-86c3456dd3ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:51.805721 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-72c1a357-23e0-4ddd-a3ab-86c3456dd3ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:51.815082 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-72c1a357-23e0-4ddd-a3ab-86c3456dd3ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1682 microversion: 2.1 time: 0.149546 Jun 02 13:40:51.815651 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 301/631] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:51 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:52.291495 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ba05f8ab-5cd9-4c9e-ab4a-12112526b75d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:52.292146 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ba05f8ab-5cd9-4c9e-ab4a-12112526b75d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:52.298979 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba05f8ab-5cd9-4c9e-ab4a-12112526b75d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:52.299438 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba05f8ab-5cd9-4c9e-ab4a-12112526b75d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:52.300214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba05f8ab-5cd9-4c9e-ab4a-12112526b75d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:52.300687 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba05f8ab-5cd9-4c9e-ab4a-12112526b75d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:52.302021 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-85fc1893-93c9-4361-ad57-096abbf6c3cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:52.302640 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-85fc1893-93c9-4361-ad57-096abbf6c3cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:52.308821 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85fc1893-93c9-4361-ad57-096abbf6c3cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:52.309279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85fc1893-93c9-4361-ad57-096abbf6c3cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:52.310050 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85fc1893-93c9-4361-ad57-096abbf6c3cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:52.310492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85fc1893-93c9-4361-ad57-096abbf6c3cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:52.493784 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ba05f8ab-5cd9-4c9e-ab4a-12112526b75d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:52.497657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-85fc1893-93c9-4361-ad57-096abbf6c3cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:52.502538 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ba05f8ab-5cd9-4c9e-ab4a-12112526b75d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.214890 Jun 02 13:40:52.503306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 331/632] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:52 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:52.505832 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-85fc1893-93c9-4361-ad57-096abbf6c3cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.207545 Jun 02 13:40:52.506511 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 302/633] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:52 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:40:52.507910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-75813a90-a5e3-4707-97fa-33a45fbfc2a0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:52.508698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-75813a90-a5e3-4707-97fa-33a45fbfc2a0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:52.514537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-75813a90-a5e3-4707-97fa-33a45fbfc2a0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:52.515067 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-75813a90-a5e3-4707-97fa-33a45fbfc2a0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:52.515842 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-75813a90-a5e3-4707-97fa-33a45fbfc2a0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:52.516289 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-75813a90-a5e3-4707-97fa-33a45fbfc2a0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:52.832671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e26102b4-2ea9-455b-8012-ead6cb20e37f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:52.833686 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e26102b4-2ea9-455b-8012-ead6cb20e37f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:52.841126 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e26102b4-2ea9-455b-8012-ead6cb20e37f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:52.841680 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e26102b4-2ea9-455b-8012-ead6cb20e37f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:52.842466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e26102b4-2ea9-455b-8012-ead6cb20e37f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:52.842904 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e26102b4-2ea9-455b-8012-ead6cb20e37f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:52.884267 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-75813a90-a5e3-4707-97fa-33a45fbfc2a0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:52.893768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-75813a90-a5e3-4707-97fa-33a45fbfc2a0 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1759 microversion: 2.1 time: 0.389366 Jun 02 13:40:52.894573 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 332/634] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:52 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1759 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:52.979076 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e26102b4-2ea9-455b-8012-ead6cb20e37f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:52.987248 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e26102b4-2ea9-455b-8012-ead6cb20e37f tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1682 microversion: 2.1 time: 0.158666 Jun 02 13:40:52.987812 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 303/635] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:52 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:53.519855 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a0b37919-67e2-42af-b1a1-04182c27c269 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:53.520677 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a0b37919-67e2-42af-b1a1-04182c27c269 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:53.522181 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c593f70a-33d7-48e8-b106-dfe14d508be7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:53.522804 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c593f70a-33d7-48e8-b106-dfe14d508be7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:53.527742 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0b37919-67e2-42af-b1a1-04182c27c269 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:53.528409 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0b37919-67e2-42af-b1a1-04182c27c269 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:53.528809 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c593f70a-33d7-48e8-b106-dfe14d508be7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:53.529267 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c593f70a-33d7-48e8-b106-dfe14d508be7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:53.529385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0b37919-67e2-42af-b1a1-04182c27c269 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:53.529845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0b37919-67e2-42af-b1a1-04182c27c269 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:53.530037 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c593f70a-33d7-48e8-b106-dfe14d508be7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:53.530639 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c593f70a-33d7-48e8-b106-dfe14d508be7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:53.730543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c593f70a-33d7-48e8-b106-dfe14d508be7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:53.733873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a0b37919-67e2-42af-b1a1-04182c27c269 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:53.738687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c593f70a-33d7-48e8-b106-dfe14d508be7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.220310 Jun 02 13:40:53.739483 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 304/636] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:53 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:40:53.742810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a0b37919-67e2-42af-b1a1-04182c27c269 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.227527 Jun 02 13:40:53.743538 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 333/637] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:53 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:53.874654 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-b94053ba-3249-408f-b2ae-80a4465b022e req-d1d3d98a-3c30-45f9-a43e-28bd8d6c4494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123ffac0-b1c6-4d56-a959-9dddf4e649c3", "name": "network-vif-deleted", "tag": "ce43ce14-85b8-42b3-a50e-e16e10512b50"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:53.884656 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b94053ba-3249-408f-b2ae-80a4465b022e req-d1d3d98a-3c30-45f9-a43e-28bd8d6c4494 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:53.885039 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b94053ba-3249-408f-b2ae-80a4465b022e req-d1d3d98a-3c30-45f9-a43e-28bd8d6c4494 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:53.889394 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:53.897279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-b94053ba-3249-408f-b2ae-80a4465b022e req-d1d3d98a-3c30-45f9-a43e-28bd8d6c4494 service nova] Creating event network-vif-deleted:ce43ce14-85b8-42b3-a50e-e16e10512b50 for instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 on hv-cinder-83608 Jun 02 13:40:53.902914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-b94053ba-3249-408f-b2ae-80a4465b022e req-d1d3d98a-3c30-45f9-a43e-28bd8d6c4494 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032648 Jun 02 13:40:53.903799 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 305/638] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:40:54.016028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-80cc523c-c508-4af2-9c7f-213cfdccaf8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:54.016687 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-80cc523c-c508-4af2-9c7f-213cfdccaf8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:54.022945 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-80cc523c-c508-4af2-9c7f-213cfdccaf8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:54.023438 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-80cc523c-c508-4af2-9c7f-213cfdccaf8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:54.024226 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-80cc523c-c508-4af2-9c7f-213cfdccaf8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:54.025760 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-80cc523c-c508-4af2-9c7f-213cfdccaf8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:54.092766 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-80cc523c-c508-4af2-9c7f-213cfdccaf8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:54.102842 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-80cc523c-c508-4af2-9c7f-213cfdccaf8e tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 200 len: 1326 microversion: 2.1 time: 0.101389 Jun 02 13:40:54.103709 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 334/639] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:54 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:40:54.759469 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8cf3509f-abc9-4415-9106-778992f59332 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:54.759946 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d1b40076-9eee-4e10-ba3c-f1ee9a7a785d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:54.760622 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d1b40076-9eee-4e10-ba3c-f1ee9a7a785d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:54.761179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8cf3509f-abc9-4415-9106-778992f59332 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:54.768437 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1b40076-9eee-4e10-ba3c-f1ee9a7a785d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:54.769174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1b40076-9eee-4e10-ba3c-f1ee9a7a785d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:54.769967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1b40076-9eee-4e10-ba3c-f1ee9a7a785d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:54.770584 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1b40076-9eee-4e10-ba3c-f1ee9a7a785d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:54.779223 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cf3509f-abc9-4415-9106-778992f59332 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:54.779667 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cf3509f-abc9-4415-9106-778992f59332 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:54.780497 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cf3509f-abc9-4415-9106-778992f59332 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:54.780950 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cf3509f-abc9-4415-9106-778992f59332 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:54.985146 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d1b40076-9eee-4e10-ba3c-f1ee9a7a785d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:54.989388 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:54.989679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8cf3509f-abc9-4415-9106-778992f59332 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:54.995539 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d1b40076-9eee-4e10-ba3c-f1ee9a7a785d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.239313 Jun 02 13:40:54.996124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 335/640] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:54 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:40:54.997700 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8cf3509f-abc9-4415-9106-778992f59332 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.246370 Jun 02 13:40:54.998268 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 306/641] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:54 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:55.121625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bc95b1ed-5223-4eaa-8775-1f923f7eaa03 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:55.122157 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bc95b1ed-5223-4eaa-8775-1f923f7eaa03 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:55.129922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc95b1ed-5223-4eaa-8775-1f923f7eaa03 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:55.130373 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc95b1ed-5223-4eaa-8775-1f923f7eaa03 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:55.131137 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc95b1ed-5223-4eaa-8775-1f923f7eaa03 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:55.131569 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc95b1ed-5223-4eaa-8775-1f923f7eaa03 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:55.147046 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-bc95b1ed-5223-4eaa-8775-1f923f7eaa03 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bc95b1ed-5223-4eaa-8775-1f923f7eaa03 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 HTTP/1.1 Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:40:55.148711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:40:55.150424 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '123ffac0-b1c6-4d56-a959-9dddf4e649c3'} Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:40:55.151223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:40:55.152700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:40:55.153982 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bc95b1ed-5223-4eaa-8775-1f923f7eaa03 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:40:55.153982 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bc95b1ed-5223-4eaa-8775-1f923f7eaa03 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 404 len: 111 microversion: 2.1 time: 0.032590 Jun 02 13:40:55.153982 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 336/642] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:55 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:40:55.159076 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a74f6cc9-ea42-46dc-9b4f-4b4d2b32b89a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '.version_select at 0x7f861502f670>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:55.178888 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a74f6cc9-ea42-46dc-9b4f-4b4d2b32b89a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127387470" status: 202 len: 0 microversion: 2.1 time: 0.023641 Jun 02 13:40:55.179449 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 307/643] 10.222.0.32 () {58 vars in 1220 bytes} [Thu Jun 2 13:40:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127387470 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:40:55.775418 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-59a2c0f8-1faf-4282-809d-4902e31da3d1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: .version_select at 0x7f8614f6d430>, body: {"keypair": {"name": "tempest-keypair-530991509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJOcEn0c/0yimjT5z1RTX3bEO1Sl3y3Sp+32tFQitFCfX8VJxpFIXtT5ASNdLgSZMzvztvJAmzKxEA6sKaVVCaqpd32YBbLMGbyzOQvBxvLOzVeVPJul/HYd6tuZZCDRA=="}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:55.789843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-59a2c0f8-1faf-4282-809d-4902e31da3d1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:40:55.793595 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-59a2c0f8-1faf-4282-809d-4902e31da3d1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for user a1622acb057f419ca98e7d44584c276d and project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:40:55.815459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-59a2c0f8-1faf-4282-809d-4902e31da3d1 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043919 Jun 02 13:40:55.816039 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 337/644] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Jun 2 13:40:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:40:56.015976 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dd287fc5-4f7e-435d-8116-93ff1e94a3f3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:56.016692 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dd287fc5-4f7e-435d-8116-93ff1e94a3f3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:56.017464 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-10a74309-e3f1-4487-aa8a-f3561a2e708a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:56.017819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-10a74309-e3f1-4487-aa8a-f3561a2e708a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:56.024129 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd287fc5-4f7e-435d-8116-93ff1e94a3f3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:56.024690 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd287fc5-4f7e-435d-8116-93ff1e94a3f3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:56.025123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10a74309-e3f1-4487-aa8a-f3561a2e708a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:56.025584 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10a74309-e3f1-4487-aa8a-f3561a2e708a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:56.026269 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd287fc5-4f7e-435d-8116-93ff1e94a3f3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:56.026372 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10a74309-e3f1-4487-aa8a-f3561a2e708a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:56.026782 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd287fc5-4f7e-435d-8116-93ff1e94a3f3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:56.026883 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10a74309-e3f1-4487-aa8a-f3561a2e708a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:56.249388 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-10a74309-e3f1-4487-aa8a-f3561a2e708a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:56.257530 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dd287fc5-4f7e-435d-8116-93ff1e94a3f3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:56.262142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-10a74309-e3f1-4487-aa8a-f3561a2e708a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.248913 Jun 02 13:40:56.262958 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 338/645] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:56 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:56.278549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dd287fc5-4f7e-435d-8116-93ff1e94a3f3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.266371 Jun 02 13:40:56.279241 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 308/646] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:56 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:57.164513 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1312011214", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dbc7e40-4f9d-4008-913e-157e6f3d947d"}], "security_groups": [{"name": "tempest-securitygroup--21436734"}], "key_name": "tempest-keypair-530991509", "user_data": "}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:40:57.265138 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] validate_networks() for [('4dbc7e40-4f9d-4008-913e-157e6f3d947d', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:40:57.278969 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-32bba822-6655-4a61-84a3-c08458d41498 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:57.279590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-32bba822-6655-4a61-84a3-c08458d41498 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:57.286720 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32bba822-6655-4a61-84a3-c08458d41498 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:57.287179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32bba822-6655-4a61-84a3-c08458d41498 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:57.287946 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32bba822-6655-4a61-84a3-c08458d41498 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:57.288409 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32bba822-6655-4a61-84a3-c08458d41498 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:57.464826 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-32bba822-6655-4a61-84a3-c08458d41498 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:57.473464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-32bba822-6655-4a61-84a3-c08458d41498 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.198422 Jun 02 13:40:57.474047 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 309/647] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:57 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:57.478676 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-408ead2b-6545-484c-8cb6-2427f7314664 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:57.479286 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-408ead2b-6545-484c-8cb6-2427f7314664 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:57.485199 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408ead2b-6545-484c-8cb6-2427f7314664 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:57.485648 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408ead2b-6545-484c-8cb6-2427f7314664 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:57.486444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408ead2b-6545-484c-8cb6-2427f7314664 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:57.486881 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408ead2b-6545-484c-8cb6-2427f7314664 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:57.689033 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-408ead2b-6545-484c-8cb6-2427f7314664 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:57.696416 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-408ead2b-6545-484c-8cb6-2427f7314664 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.221217 Jun 02 13:40:57.696984 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 310/648] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:57 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:57.767283 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:40:57.767739 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:40:57.768212 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:40:57.768644 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:40:57.769055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:40:57.777910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:57.778351 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:57.779150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:57.779585 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:57.796206 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:40:57.800863 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for user a1622acb057f419ca98e7d44584c276d and project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:40:57.811822 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:40:57.814122 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:40:57.840837 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:40:57.860291 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-dc3d4a6d-bdef-45b8-9aec-71abaf9aa6cf tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.700015 Jun 02 13:40:57.861521 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 339/649] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:40:57 2022] POST /compute/v2.1/servers => generated 400 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:40:57.871543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-abd80297-c9ee-487e-8224-a5df4e652cf6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:57.872279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-abd80297-c9ee-487e-8224-a5df4e652cf6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:57.925730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-abd80297-c9ee-487e-8224-a5df4e652cf6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:57.932367 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-abd80297-c9ee-487e-8224-a5df4e652cf6 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1241 microversion: 2.1 time: 0.064739 Jun 02 13:40:57.933126 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 311/650] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:57 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:58.491536 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c6806796-1437-4b57-8854-6c50aba5b6c9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:58.492079 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c6806796-1437-4b57-8854-6c50aba5b6c9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:58.499026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6806796-1437-4b57-8854-6c50aba5b6c9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:58.499490 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6806796-1437-4b57-8854-6c50aba5b6c9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:58.500268 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6806796-1437-4b57-8854-6c50aba5b6c9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:58.500740 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6806796-1437-4b57-8854-6c50aba5b6c9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:58.625888 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c6806796-1437-4b57-8854-6c50aba5b6c9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:58.634325 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c6806796-1437-4b57-8854-6c50aba5b6c9 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.147847 Jun 02 13:40:58.634904 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 340/651] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:58 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:58.713664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-54d1c02b-9c3f-412e-b0eb-6fc45274029d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:58.714275 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-54d1c02b-9c3f-412e-b0eb-6fc45274029d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:58.720766 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54d1c02b-9c3f-412e-b0eb-6fc45274029d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:58.721214 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54d1c02b-9c3f-412e-b0eb-6fc45274029d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:58.721969 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54d1c02b-9c3f-412e-b0eb-6fc45274029d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:58.722399 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54d1c02b-9c3f-412e-b0eb-6fc45274029d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:58.853496 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-54d1c02b-9c3f-412e-b0eb-6fc45274029d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:58.861768 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-54d1c02b-9c3f-412e-b0eb-6fc45274029d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.151958 Jun 02 13:40:58.862341 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 312/652] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:58 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:58.949275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ed0dc659-357b-47aa-abef-c04e18106fe7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:58.949895 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ed0dc659-357b-47aa-abef-c04e18106fe7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:58.956318 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ed0dc659-357b-47aa-abef-c04e18106fe7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:58.956785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ed0dc659-357b-47aa-abef-c04e18106fe7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:58.957554 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ed0dc659-357b-47aa-abef-c04e18106fe7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:58.957994 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ed0dc659-357b-47aa-abef-c04e18106fe7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:59.019386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ed0dc659-357b-47aa-abef-c04e18106fe7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:59.027034 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ed0dc659-357b-47aa-abef-c04e18106fe7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1301 microversion: 2.1 time: 0.081632 Jun 02 13:40:59.027620 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 341/653] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:58 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:59.651282 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6c9f1abe-7f38-4c3f-afdd-3ac5a564d689 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:59.651809 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6c9f1abe-7f38-4c3f-afdd-3ac5a564d689 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:59.657835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6c9f1abe-7f38-4c3f-afdd-3ac5a564d689 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:59.658290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6c9f1abe-7f38-4c3f-afdd-3ac5a564d689 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:59.659732 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6c9f1abe-7f38-4c3f-afdd-3ac5a564d689 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:59.660166 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6c9f1abe-7f38-4c3f-afdd-3ac5a564d689 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:59.788843 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6c9f1abe-7f38-4c3f-afdd-3ac5a564d689 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:40:59.798523 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6c9f1abe-7f38-4c3f-afdd-3ac5a564d689 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.151249 Jun 02 13:40:59.799107 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 313/654] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:59 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:40:59.881522 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2947c13d-eda3-476b-926f-e2bc8d40433d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:40:59.882377 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2947c13d-eda3-476b-926f-e2bc8d40433d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:40:59.888893 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2947c13d-eda3-476b-926f-e2bc8d40433d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:59.889486 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2947c13d-eda3-476b-926f-e2bc8d40433d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:40:59.890375 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2947c13d-eda3-476b-926f-e2bc8d40433d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:40:59.891046 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2947c13d-eda3-476b-926f-e2bc8d40433d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:00.036748 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2947c13d-eda3-476b-926f-e2bc8d40433d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:00.044275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2947c13d-eda3-476b-926f-e2bc8d40433d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.169002 Jun 02 13:41:00.044812 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-06be76c7-dc14-4e36-92ed-90ce76286d04 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:00.044948 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 342/655] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:40:59 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:00.045853 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-06be76c7-dc14-4e36-92ed-90ce76286d04 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:00.052573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-06be76c7-dc14-4e36-92ed-90ce76286d04 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:00.053229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-06be76c7-dc14-4e36-92ed-90ce76286d04 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:00.054164 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-06be76c7-dc14-4e36-92ed-90ce76286d04 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:00.054773 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-06be76c7-dc14-4e36-92ed-90ce76286d04 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:00.185135 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-06be76c7-dc14-4e36-92ed-90ce76286d04 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:00.193629 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-06be76c7-dc14-4e36-92ed-90ce76286d04 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1365 microversion: 2.1 time: 0.152852 Jun 02 13:41:00.194291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 314/656] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:00 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:00.594649 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-64b7a62e-5d70-462d-ac6e-337cabc4c50d req-dfd71404-7e35-4a90-94b3-1041ac32faf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d660d9e5-4816-47f4-b60a-922f53b35cd2", "tag": "134a0cd2-dac2-45ac-9b9d-f77942327b3a"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:00.602759 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-64b7a62e-5d70-462d-ac6e-337cabc4c50d req-dfd71404-7e35-4a90-94b3-1041ac32faf8 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:00.603221 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-64b7a62e-5d70-462d-ac6e-337cabc4c50d req-dfd71404-7e35-4a90-94b3-1041ac32faf8 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:00.615140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-64b7a62e-5d70-462d-ac6e-337cabc4c50d req-dfd71404-7e35-4a90-94b3-1041ac32faf8 service nova] Creating event network-changed:134a0cd2-dac2-45ac-9b9d-f77942327b3a for instance d660d9e5-4816-47f4-b60a-922f53b35cd2 on hv-cinder-83608 Jun 02 13:41:00.620253 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-64b7a62e-5d70-462d-ac6e-337cabc4c50d req-dfd71404-7e35-4a90-94b3-1041ac32faf8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029266 Jun 02 13:41:00.620918 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 343/657] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:41:00.815642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6f892a7d-cbd2-4519-a5b0-bc4198b1c8b7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:00.816267 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6f892a7d-cbd2-4519-a5b0-bc4198b1c8b7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:00.822909 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f892a7d-cbd2-4519-a5b0-bc4198b1c8b7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:00.823422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f892a7d-cbd2-4519-a5b0-bc4198b1c8b7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:00.824220 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f892a7d-cbd2-4519-a5b0-bc4198b1c8b7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:00.824682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f892a7d-cbd2-4519-a5b0-bc4198b1c8b7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:00.964057 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6f892a7d-cbd2-4519-a5b0-bc4198b1c8b7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:00.971989 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6f892a7d-cbd2-4519-a5b0-bc4198b1c8b7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.161010 Jun 02 13:41:00.972586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 315/658] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:00 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:01.062397 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-275d29d1-6b1b-4beb-acfe-d5a6adadbc53 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:01.063104 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-275d29d1-6b1b-4beb-acfe-d5a6adadbc53 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:01.070061 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-275d29d1-6b1b-4beb-acfe-d5a6adadbc53 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:01.070525 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-275d29d1-6b1b-4beb-acfe-d5a6adadbc53 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:01.071321 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-275d29d1-6b1b-4beb-acfe-d5a6adadbc53 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:01.071768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-275d29d1-6b1b-4beb-acfe-d5a6adadbc53 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:01.200781 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-275d29d1-6b1b-4beb-acfe-d5a6adadbc53 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:01.208567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-275d29d1-6b1b-4beb-acfe-d5a6adadbc53 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.150898 Jun 02 13:41:01.209124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 344/659] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:01 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:01.210875 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4d866cb4-9a44-4945-bd19-34f21aca02f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:01.211581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4d866cb4-9a44-4945-bd19-34f21aca02f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:01.217689 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d866cb4-9a44-4945-bd19-34f21aca02f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:01.218147 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d866cb4-9a44-4945-bd19-34f21aca02f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:01.218912 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d866cb4-9a44-4945-bd19-34f21aca02f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:01.219354 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d866cb4-9a44-4945-bd19-34f21aca02f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:01.343659 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4d866cb4-9a44-4945-bd19-34f21aca02f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:01.351559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4d866cb4-9a44-4945-bd19-34f21aca02f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1365 microversion: 2.1 time: 0.144598 Jun 02 13:41:01.352123 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 316/660] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:01 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:01.989147 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-20ac36db-bdca-4d1a-9dcf-2775f01c03fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:01.989755 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-20ac36db-bdca-4d1a-9dcf-2775f01c03fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:01.995778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20ac36db-bdca-4d1a-9dcf-2775f01c03fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:01.996227 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20ac36db-bdca-4d1a-9dcf-2775f01c03fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:01.997020 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20ac36db-bdca-4d1a-9dcf-2775f01c03fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:01.997457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20ac36db-bdca-4d1a-9dcf-2775f01c03fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:02.126144 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-20ac36db-bdca-4d1a-9dcf-2775f01c03fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:02.134500 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-20ac36db-bdca-4d1a-9dcf-2775f01c03fa tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.149266 Jun 02 13:41:02.135064 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 345/661] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:01 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:02.225134 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2f4a1d05-c8dc-4cf8-8943-530d76584e17 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:02.225738 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2f4a1d05-c8dc-4cf8-8943-530d76584e17 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:02.232130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f4a1d05-c8dc-4cf8-8943-530d76584e17 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:02.232603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f4a1d05-c8dc-4cf8-8943-530d76584e17 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:02.233368 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f4a1d05-c8dc-4cf8-8943-530d76584e17 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:02.233795 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f4a1d05-c8dc-4cf8-8943-530d76584e17 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:02.357951 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2f4a1d05-c8dc-4cf8-8943-530d76584e17 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:02.365474 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2f4a1d05-c8dc-4cf8-8943-530d76584e17 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.144114 Jun 02 13:41:02.366029 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 317/662] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:02 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:02.368217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bec4827a-e8be-4b08-ae83-9f0856c79a25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:02.368863 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bec4827a-e8be-4b08-ae83-9f0856c79a25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:02.374822 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bec4827a-e8be-4b08-ae83-9f0856c79a25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:02.375276 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bec4827a-e8be-4b08-ae83-9f0856c79a25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:02.376037 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bec4827a-e8be-4b08-ae83-9f0856c79a25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:02.376552 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bec4827a-e8be-4b08-ae83-9f0856c79a25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:02.510820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bec4827a-e8be-4b08-ae83-9f0856c79a25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:02.518513 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bec4827a-e8be-4b08-ae83-9f0856c79a25 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1365 microversion: 2.1 time: 0.154068 Jun 02 13:41:02.519072 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 346/663] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:02 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:03.152109 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-73150865-a4eb-4ab7-a9ee-24957ef75261 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:03.152658 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-73150865-a4eb-4ab7-a9ee-24957ef75261 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:03.154689 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:03.160435 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73150865-a4eb-4ab7-a9ee-24957ef75261 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:03.160881 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73150865-a4eb-4ab7-a9ee-24957ef75261 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:03.161637 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73150865-a4eb-4ab7-a9ee-24957ef75261 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:03.162068 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73150865-a4eb-4ab7-a9ee-24957ef75261 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:03.289219 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-73150865-a4eb-4ab7-a9ee-24957ef75261 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:03.297098 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-73150865-a4eb-4ab7-a9ee-24957ef75261 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.149002 Jun 02 13:41:03.297651 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 318/664] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:03 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:03.383680 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-aa41faf3-bc53-4753-b631-bed9c5da991f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:03.384320 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-aa41faf3-bc53-4753-b631-bed9c5da991f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:03.393634 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aa41faf3-bc53-4753-b631-bed9c5da991f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:03.394087 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aa41faf3-bc53-4753-b631-bed9c5da991f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:03.394844 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aa41faf3-bc53-4753-b631-bed9c5da991f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:03.395280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aa41faf3-bc53-4753-b631-bed9c5da991f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:03.520806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-aa41faf3-bc53-4753-b631-bed9c5da991f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:03.528141 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-aa41faf3-bc53-4753-b631-bed9c5da991f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.149670 Jun 02 13:41:03.528735 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 347/665] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:03 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:03.535271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c4ae0a0d-27ea-4e66-85fa-c342e39e91da tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:03.535968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c4ae0a0d-27ea-4e66-85fa-c342e39e91da tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:03.542015 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4ae0a0d-27ea-4e66-85fa-c342e39e91da tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:03.542459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4ae0a0d-27ea-4e66-85fa-c342e39e91da tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:03.543214 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4ae0a0d-27ea-4e66-85fa-c342e39e91da tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:03.543642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c4ae0a0d-27ea-4e66-85fa-c342e39e91da tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:03.671231 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c4ae0a0d-27ea-4e66-85fa-c342e39e91da tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:03.678633 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c4ae0a0d-27ea-4e66-85fa-c342e39e91da tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1365 microversion: 2.1 time: 0.147722 Jun 02 13:41:03.679194 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 319/666] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:03 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:04.314146 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-055f0482-2dba-4ac9-ad14-0d379f7758a1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:04.314824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-055f0482-2dba-4ac9-ad14-0d379f7758a1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:04.320905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-055f0482-2dba-4ac9-ad14-0d379f7758a1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:04.321374 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-055f0482-2dba-4ac9-ad14-0d379f7758a1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:04.322151 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-055f0482-2dba-4ac9-ad14-0d379f7758a1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:04.322600 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-055f0482-2dba-4ac9-ad14-0d379f7758a1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:04.451806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-055f0482-2dba-4ac9-ad14-0d379f7758a1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:04.477317 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-055f0482-2dba-4ac9-ad14-0d379f7758a1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.167074 Jun 02 13:41:04.478007 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 348/667] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:04 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:04.545370 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-84d5471e-a521-460b-8f29-6e6526d4b5ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:04.545994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-84d5471e-a521-460b-8f29-6e6526d4b5ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:04.553563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84d5471e-a521-460b-8f29-6e6526d4b5ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:04.554019 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84d5471e-a521-460b-8f29-6e6526d4b5ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:04.554785 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84d5471e-a521-460b-8f29-6e6526d4b5ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:04.555222 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84d5471e-a521-460b-8f29-6e6526d4b5ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:04.685929 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-84d5471e-a521-460b-8f29-6e6526d4b5ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:04.694204 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-84d5471e-a521-460b-8f29-6e6526d4b5ef tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.152656 Jun 02 13:41:04.694758 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 320/668] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:04 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:04.695676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ddd3a471-d987-43e7-8891-fc76bfa4d710 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:04.696329 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ddd3a471-d987-43e7-8891-fc76bfa4d710 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:04.702274 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddd3a471-d987-43e7-8891-fc76bfa4d710 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:04.702717 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddd3a471-d987-43e7-8891-fc76bfa4d710 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:04.703732 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddd3a471-d987-43e7-8891-fc76bfa4d710 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:04.704167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddd3a471-d987-43e7-8891-fc76bfa4d710 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:04.829545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ddd3a471-d987-43e7-8891-fc76bfa4d710 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:04.837454 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ddd3a471-d987-43e7-8891-fc76bfa4d710 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1365 microversion: 2.1 time: 0.145776 Jun 02 13:41:04.838019 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 349/669] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:04 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:04.881293 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-098c3643-3233-4255-96d1-7853fb169420 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:04.881792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-098c3643-3233-4255-96d1-7853fb169420 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:04.887813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-098c3643-3233-4255-96d1-7853fb169420 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:04.888290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-098c3643-3233-4255-96d1-7853fb169420 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:04.889087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-098c3643-3233-4255-96d1-7853fb169420 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:04.889524 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-098c3643-3233-4255-96d1-7853fb169420 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:04.917912 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-098c3643-3233-4255-96d1-7853fb169420 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments/6aa0d856-13e1-4925-a0ea-a8e102e77736" status: 200 len: 194 microversion: 2.20 time: 0.040639 Jun 02 13:41:04.918481 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 321/670] 10.222.0.32 () {60 vars in 1453 bytes} [Thu Jun 2 13:41:04 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments/6aa0d856-13e1-4925-a0ea-a8e102e77736 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:41:04.981440 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-975fe345-c5fe-453e-a0c9-54c0e9f1db63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:04.981944 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-975fe345-c5fe-453e-a0c9-54c0e9f1db63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:04.987881 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-975fe345-c5fe-453e-a0c9-54c0e9f1db63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:04.988403 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-975fe345-c5fe-453e-a0c9-54c0e9f1db63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:04.989189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-975fe345-c5fe-453e-a0c9-54c0e9f1db63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:04.989642 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-975fe345-c5fe-453e-a0c9-54c0e9f1db63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:05.071267 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-975fe345-c5fe-453e-a0c9-54c0e9f1db63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lazy-loading 'services' on Instance uuid bf15208f-0bda-407c-8ea0-38a1300bfa16 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:41:05.140350 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-975fe345-c5fe-453e-a0c9-54c0e9f1db63 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments/6aa0d856-13e1-4925-a0ea-a8e102e77736" status: 202 len: 0 microversion: 2.20 time: 0.162672 Jun 02 13:41:05.141395 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 350/671] 10.222.0.32 () {60 vars in 1456 bytes} [Thu Jun 2 13:41:04 2022] DELETE /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments/6aa0d856-13e1-4925-a0ea-a8e102e77736 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:41:05.149985 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8359829f-fd5d-4d77-b07e-9d070a26eca9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:05.150977 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8359829f-fd5d-4d77-b07e-9d070a26eca9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:05.156985 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8359829f-fd5d-4d77-b07e-9d070a26eca9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:05.157442 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8359829f-fd5d-4d77-b07e-9d070a26eca9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:05.158208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8359829f-fd5d-4d77-b07e-9d070a26eca9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:05.158677 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8359829f-fd5d-4d77-b07e-9d070a26eca9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:05.186623 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8359829f-fd5d-4d77-b07e-9d070a26eca9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040680 Jun 02 13:41:05.187160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 322/672] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Jun 2 13:41:05 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:41:05.494730 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e9978233-577d-49a6-9b4f-04391d08d487 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:05.495345 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e9978233-577d-49a6-9b4f-04391d08d487 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:05.501530 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9978233-577d-49a6-9b4f-04391d08d487 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:05.501980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9978233-577d-49a6-9b4f-04391d08d487 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:05.503413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9978233-577d-49a6-9b4f-04391d08d487 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:05.503874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9978233-577d-49a6-9b4f-04391d08d487 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:05.638321 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e9978233-577d-49a6-9b4f-04391d08d487 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:05.647315 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e9978233-577d-49a6-9b4f-04391d08d487 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.157196 Jun 02 13:41:05.647689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 351/673] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:05 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:05.711126 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a80239fb-eecb-4044-a9ce-246334b64ee3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:05.711739 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a80239fb-eecb-4044-a9ce-246334b64ee3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:05.717822 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a80239fb-eecb-4044-a9ce-246334b64ee3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:05.718267 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a80239fb-eecb-4044-a9ce-246334b64ee3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:05.719027 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a80239fb-eecb-4044-a9ce-246334b64ee3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:05.719462 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a80239fb-eecb-4044-a9ce-246334b64ee3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:05.847415 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a80239fb-eecb-4044-a9ce-246334b64ee3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:05.854616 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-09e77cd5-a004-4010-a2cb-5eb9a43ddf88 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:05.854939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a80239fb-eecb-4044-a9ce-246334b64ee3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.147741 Jun 02 13:41:05.855381 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-09e77cd5-a004-4010-a2cb-5eb9a43ddf88 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:05.855489 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 323/674] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:05 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:05.861557 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09e77cd5-a004-4010-a2cb-5eb9a43ddf88 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:05.862567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09e77cd5-a004-4010-a2cb-5eb9a43ddf88 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:05.863342 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09e77cd5-a004-4010-a2cb-5eb9a43ddf88 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:05.863783 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09e77cd5-a004-4010-a2cb-5eb9a43ddf88 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:05.990088 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-09e77cd5-a004-4010-a2cb-5eb9a43ddf88 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:05.997429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-09e77cd5-a004-4010-a2cb-5eb9a43ddf88 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1365 microversion: 2.1 time: 0.146645 Jun 02 13:41:05.997992 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 352/675] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:05 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:06.199017 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-44bd7b58-499d-40e6-a24c-137ce9924fcb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:06.199905 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-44bd7b58-499d-40e6-a24c-137ce9924fcb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:06.206691 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-44bd7b58-499d-40e6-a24c-137ce9924fcb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:06.207142 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-44bd7b58-499d-40e6-a24c-137ce9924fcb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:06.207907 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-44bd7b58-499d-40e6-a24c-137ce9924fcb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:06.208369 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-44bd7b58-499d-40e6-a24c-137ce9924fcb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:06.225162 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:06.238446 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-44bd7b58-499d-40e6-a24c-137ce9924fcb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043565 Jun 02 13:41:06.238995 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 324/676] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Jun 2 13:41:06 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:41:06.432048 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-016a332f-9c83-4e3f-8039-c3837b5737ab req-03b5765d-56fe-40ce-808a-f2482c049b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d660d9e5-4816-47f4-b60a-922f53b35cd2", "name": "network-vif-plugged", "status": "completed", "tag": "134a0cd2-dac2-45ac-9b9d-f77942327b3a"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:06.441196 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-016a332f-9c83-4e3f-8039-c3837b5737ab req-03b5765d-56fe-40ce-808a-f2482c049b41 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:06.442126 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-016a332f-9c83-4e3f-8039-c3837b5737ab req-03b5765d-56fe-40ce-808a-f2482c049b41 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:06.457909 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-016a332f-9c83-4e3f-8039-c3837b5737ab req-03b5765d-56fe-40ce-808a-f2482c049b41 service nova] Creating event network-vif-plugged:134a0cd2-dac2-45ac-9b9d-f77942327b3a for instance d660d9e5-4816-47f4-b60a-922f53b35cd2 on hv-cinder-83608 Jun 02 13:41:06.462809 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-016a332f-9c83-4e3f-8039-c3837b5737ab req-03b5765d-56fe-40ce-808a-f2482c049b41 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034502 Jun 02 13:41:06.463400 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 353/677] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:41:06.663267 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5c08f31e-e7cb-472f-8840-9e9ceb5d7f5b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:06.664096 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5c08f31e-e7cb-472f-8840-9e9ceb5d7f5b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:06.670497 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c08f31e-e7cb-472f-8840-9e9ceb5d7f5b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:06.670963 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c08f31e-e7cb-472f-8840-9e9ceb5d7f5b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:06.671756 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c08f31e-e7cb-472f-8840-9e9ceb5d7f5b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:06.672181 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c08f31e-e7cb-472f-8840-9e9ceb5d7f5b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:06.809612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5c08f31e-e7cb-472f-8840-9e9ceb5d7f5b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:06.818068 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5c08f31e-e7cb-472f-8840-9e9ceb5d7f5b tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.158813 Jun 02 13:41:06.818630 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 325/678] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:06 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:06.872879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-51eab805-e636-425f-b02f-874da43ed008 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:06.873605 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-51eab805-e636-425f-b02f-874da43ed008 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:06.880793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51eab805-e636-425f-b02f-874da43ed008 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:06.881243 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51eab805-e636-425f-b02f-874da43ed008 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:06.881999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51eab805-e636-425f-b02f-874da43ed008 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:06.882436 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51eab805-e636-425f-b02f-874da43ed008 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:07.017774 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8317ff37-3fc3-4ba5-8593-9d9ec7bf86f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:07.019036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8317ff37-3fc3-4ba5-8593-9d9ec7bf86f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:07.022523 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-51eab805-e636-425f-b02f-874da43ed008 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:07.028392 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8317ff37-3fc3-4ba5-8593-9d9ec7bf86f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:07.028949 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8317ff37-3fc3-4ba5-8593-9d9ec7bf86f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:07.029832 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8317ff37-3fc3-4ba5-8593-9d9ec7bf86f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:07.030387 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8317ff37-3fc3-4ba5-8593-9d9ec7bf86f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:07.031854 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-51eab805-e636-425f-b02f-874da43ed008 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.163192 Jun 02 13:41:07.032476 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 354/679] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:06 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:07.159388 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8317ff37-3fc3-4ba5-8593-9d9ec7bf86f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:07.166721 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8317ff37-3fc3-4ba5-8593-9d9ec7bf86f7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1365 microversion: 2.1 time: 0.156175 Jun 02 13:41:07.167285 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 326/680] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:07 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:07.250343 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bd36e1fc-471f-4bfd-87a7-6aa6b0a54574 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:07.251328 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bd36e1fc-471f-4bfd-87a7-6aa6b0a54574 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:07.257938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd36e1fc-471f-4bfd-87a7-6aa6b0a54574 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:07.258392 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd36e1fc-471f-4bfd-87a7-6aa6b0a54574 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:07.259574 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd36e1fc-471f-4bfd-87a7-6aa6b0a54574 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:07.259574 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd36e1fc-471f-4bfd-87a7-6aa6b0a54574 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:07.278413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:07.293999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bd36e1fc-471f-4bfd-87a7-6aa6b0a54574 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047596 Jun 02 13:41:07.294566 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 355/681] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Jun 2 13:41:07 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:41:07.835723 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2287d831-1fcc-42f5-9e1a-9e133e31ca9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:07.836246 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2287d831-1fcc-42f5-9e1a-9e133e31ca9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:07.842754 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2287d831-1fcc-42f5-9e1a-9e133e31ca9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:07.843208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2287d831-1fcc-42f5-9e1a-9e133e31ca9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:07.843997 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2287d831-1fcc-42f5-9e1a-9e133e31ca9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:07.844467 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2287d831-1fcc-42f5-9e1a-9e133e31ca9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:07.930709 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:07.979326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2287d831-1fcc-42f5-9e1a-9e133e31ca9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:07.987326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2287d831-1fcc-42f5-9e1a-9e133e31ca9c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1736 microversion: 2.1 time: 0.155561 Jun 02 13:41:07.987890 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 327/682] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:07 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:08.048543 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-04af5eef-56ad-4a7a-a08a-070c277e8cd9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:08.049211 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-04af5eef-56ad-4a7a-a08a-070c277e8cd9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:08.051206 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:08.052427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=10 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:08.058948 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-04af5eef-56ad-4a7a-a08a-070c277e8cd9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:08.059534 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-04af5eef-56ad-4a7a-a08a-070c277e8cd9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:08.060253 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-04af5eef-56ad-4a7a-a08a-070c277e8cd9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:08.061123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-04af5eef-56ad-4a7a-a08a-070c277e8cd9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:08.184076 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1d9caa83-b5d3-48b7-875a-46b07ced7724 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:08.184748 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1d9caa83-b5d3-48b7-875a-46b07ced7724 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:08.191984 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d9caa83-b5d3-48b7-875a-46b07ced7724 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:08.192273 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-04af5eef-56ad-4a7a-a08a-070c277e8cd9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:08.192502 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d9caa83-b5d3-48b7-875a-46b07ced7724 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:08.193354 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d9caa83-b5d3-48b7-875a-46b07ced7724 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:08.193891 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d9caa83-b5d3-48b7-875a-46b07ced7724 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:08.200691 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-04af5eef-56ad-4a7a-a08a-070c277e8cd9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1678 microversion: 2.1 time: 0.155946 Jun 02 13:41:08.201258 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 356/683] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:08 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:08.305885 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e0942a44-fa1a-4de0-a866-f3ee9da090ca tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:08.306797 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e0942a44-fa1a-4de0-a866-f3ee9da090ca tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:08.312702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e0942a44-fa1a-4de0-a866-f3ee9da090ca tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:08.313151 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e0942a44-fa1a-4de0-a866-f3ee9da090ca tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:08.313912 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e0942a44-fa1a-4de0-a866-f3ee9da090ca tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:08.314351 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e0942a44-fa1a-4de0-a866-f3ee9da090ca tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:08.324712 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1d9caa83-b5d3-48b7-875a-46b07ced7724 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:08.333195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1d9caa83-b5d3-48b7-875a-46b07ced7724 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1365 microversion: 2.1 time: 0.152997 Jun 02 13:41:08.333792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 328/684] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:08 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:08.344522 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e0942a44-fa1a-4de0-a866-f3ee9da090ca tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042509 Jun 02 13:41:08.345074 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 357/685] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Jun 2 13:41:08 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:08.400851 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-899c6f83-73b5-47e9-8042-2aece5d0eb54 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:08.401548 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-899c6f83-73b5-47e9-8042-2aece5d0eb54 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:08.407554 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-899c6f83-73b5-47e9-8042-2aece5d0eb54 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:08.408004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-899c6f83-73b5-47e9-8042-2aece5d0eb54 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:08.408790 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-899c6f83-73b5-47e9-8042-2aece5d0eb54 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:08.409223 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-899c6f83-73b5-47e9-8042-2aece5d0eb54 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:08.433205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-899c6f83-73b5-47e9-8042-2aece5d0eb54 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:41:08.505832 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-899c6f83-73b5-47e9-8042-2aece5d0eb54 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 204 len: 0 microversion: 2.20 time: 0.108720 Jun 02 13:41:08.506399 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 329/686] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Jun 2 13:41:08 2022] DELETE /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 13:41:08.514410 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e059e3e6-e7a6-432d-b45d-547b9a346b80 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:08.515017 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e059e3e6-e7a6-432d-b45d-547b9a346b80 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:08.520907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e059e3e6-e7a6-432d-b45d-547b9a346b80 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:08.521432 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e059e3e6-e7a6-432d-b45d-547b9a346b80 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:08.522192 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e059e3e6-e7a6-432d-b45d-547b9a346b80 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:08.522624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e059e3e6-e7a6-432d-b45d-547b9a346b80 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:08.651227 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e059e3e6-e7a6-432d-b45d-547b9a346b80 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:08.659055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e059e3e6-e7a6-432d-b45d-547b9a346b80 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:08.660574 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e059e3e6-e7a6-432d-b45d-547b9a346b80 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:08.661727 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e059e3e6-e7a6-432d-b45d-547b9a346b80 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.151134 Jun 02 13:41:08.662275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 358/687] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:08 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:09.005441 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5d9a841c-4803-478e-8d8a-6f6b95efca14 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:09.006053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5d9a841c-4803-478e-8d8a-6f6b95efca14 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:09.013285 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d9a841c-4803-478e-8d8a-6f6b95efca14 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.013745 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d9a841c-4803-478e-8d8a-6f6b95efca14 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.014528 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d9a841c-4803-478e-8d8a-6f6b95efca14 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.014998 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d9a841c-4803-478e-8d8a-6f6b95efca14 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.151284 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5d9a841c-4803-478e-8d8a-6f6b95efca14 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:09.159247 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5d9a841c-4803-478e-8d8a-6f6b95efca14 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1716 microversion: 2.1 time: 0.158676 Jun 02 13:41:09.159814 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 330/688] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:08 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:09.218353 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9379f7ff-abda-44bc-9b73-bfc99c869b89 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:09.218965 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9379f7ff-abda-44bc-9b73-bfc99c869b89 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:09.225407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9379f7ff-abda-44bc-9b73-bfc99c869b89 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.225851 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9379f7ff-abda-44bc-9b73-bfc99c869b89 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.226636 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9379f7ff-abda-44bc-9b73-bfc99c869b89 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.227070 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9379f7ff-abda-44bc-9b73-bfc99c869b89 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.263117 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dc96f339-ade1-41b3-a9be-a845d9bbc166 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:09.263754 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dc96f339-ade1-41b3-a9be-a845d9bbc166 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:09.269562 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc96f339-ade1-41b3-a9be-a845d9bbc166 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.270236 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc96f339-ade1-41b3-a9be-a845d9bbc166 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.271008 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc96f339-ade1-41b3-a9be-a845d9bbc166 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.271446 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc96f339-ade1-41b3-a9be-a845d9bbc166 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.351360 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-dc96f339-ade1-41b3-a9be-a845d9bbc166 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] HTTP exception thrown: Cannot 'detach_volume' instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 while it is in vm_state rescued Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dc96f339-ade1-41b3-a9be-a845d9bbc166 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Request method failure captured: Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments/98deeac9-760c-487f-bfc3-08b411e07fbd HTTP/1.1 Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzSOc8zAN0uDeWOclgH-FIpci9Nk5ZltTZPNxM6Pkn07DHpAN-kLw8-tMMyEZ8olBGqS-_Vv3DH24STayy7hBz2mdCS88fQh0x5WYzrT0SJLDNGvis67219B7mMEZOwSIQ5eMGU1j2HAUo9dRY8qVWWRNCbB-LBVVcpQX5WGbiIlnM Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: ff89a4ee01d444d2aee3bdc9199d556f Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:41:09.352987 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ff89a4ee01d444d2aee3bdc9199d556f"}]}] Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: ff89a4ee01d444d2aee3bdc9199d556f Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-ServerRescueNegativeTestJSON-632983293-project Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: b92da35ea7c946ea876b13b13ed98258 Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-ServerRescueNegativeTestJSON-632983293-project Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:41:09.354466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Cannot 'detach_volume' instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 while it is in vm_state rescued Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'server_id': '2d8851d9-9e33-4d8f-b120-f3b71a4f44a0', 'id': '98deeac9-760c-487f-bfc3-08b411e07fbd'} Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:41:09.355272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 while it is in vm_state rescued Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 while it is in vm_state rescued Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:41:09.356722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dc96f339-ade1-41b3-a9be-a845d9bbc166 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Returning 409 to user: Cannot 'detach_volume' instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 while it is in vm_state rescued {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:41:09.357814 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dc96f339-ade1-41b3-a9be-a845d9bbc166 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments/98deeac9-760c-487f-bfc3-08b411e07fbd" status: 409 len: 152 microversion: 2.1 time: 0.095293 Jun 02 13:41:09.358331 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 331/689] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:41:09 2022] DELETE /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments/98deeac9-760c-487f-bfc3-08b411e07fbd => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 02 13:41:09.363369 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-45396a12-324f-4a7e-87f6-75a074e26d4c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:09.363977 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-45396a12-324f-4a7e-87f6-75a074e26d4c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:09.369718 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45396a12-324f-4a7e-87f6-75a074e26d4c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.370168 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45396a12-324f-4a7e-87f6-75a074e26d4c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.370927 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45396a12-324f-4a7e-87f6-75a074e26d4c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.371366 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45396a12-324f-4a7e-87f6-75a074e26d4c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.567498 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-45396a12-324f-4a7e-87f6-75a074e26d4c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:09.570742 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9379f7ff-abda-44bc-9b73-bfc99c869b89 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:09.574957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-45396a12-324f-4a7e-87f6-75a074e26d4c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1365 microversion: 2.1 time: 0.215659 Jun 02 13:41:09.575603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 332/690] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:09 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:09.578407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9379f7ff-abda-44bc-9b73-bfc99c869b89 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1655 microversion: 2.1 time: 0.363602 Jun 02 13:41:09.578967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 359/691] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:09 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1655 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:09.580575 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e32c28fc-f856-4438-90a2-98a4a6069e05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:09.581170 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e32c28fc-f856-4438-90a2-98a4a6069e05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:09.586898 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e32c28fc-f856-4438-90a2-98a4a6069e05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.587342 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e32c28fc-f856-4438-90a2-98a4a6069e05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.588099 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e32c28fc-f856-4438-90a2-98a4a6069e05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.588559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e32c28fc-f856-4438-90a2-98a4a6069e05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.594529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e8b10cca-779a-48f3-8770-80ed19364dd4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:09.600997 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e8b10cca-779a-48f3-8770-80ed19364dd4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.601454 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e8b10cca-779a-48f3-8770-80ed19364dd4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.623532 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e8b10cca-779a-48f3-8770-80ed19364dd4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Going to try to start instance {{(pid=124123) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 13:41:09.654790 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e32c28fc-f856-4438-90a2-98a4a6069e05 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "POST /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/action" status: 202 len: 0 microversion: 2.1 time: 0.077908 Jun 02 13:41:09.659411 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 333/692] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:41:09 2022] POST /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:41:09.665058 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-05bcbc21-0076-4d33-a760-aeda4ab2d2e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:09.665820 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-05bcbc21-0076-4d33-a760-aeda4ab2d2e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:09.668773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e8b10cca-779a-48f3-8770-80ed19364dd4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/action" status: 202 len: 0 microversion: 2.1 time: 0.077914 Jun 02 13:41:09.669663 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 360/693] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:41:09 2022] POST /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:41:09.673326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05bcbc21-0076-4d33-a760-aeda4ab2d2e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.673844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05bcbc21-0076-4d33-a760-aeda4ab2d2e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.675288 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05bcbc21-0076-4d33-a760-aeda4ab2d2e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.675728 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05bcbc21-0076-4d33-a760-aeda4ab2d2e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.678415 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e2fdfc12-45f1-48a6-bbfa-b462f69e30ab tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:09.679118 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e2fdfc12-45f1-48a6-bbfa-b462f69e30ab tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:09.685317 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2fdfc12-45f1-48a6-bbfa-b462f69e30ab tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.685778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2fdfc12-45f1-48a6-bbfa-b462f69e30ab tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.686557 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2fdfc12-45f1-48a6-bbfa-b462f69e30ab tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.687001 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2fdfc12-45f1-48a6-bbfa-b462f69e30ab tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.870967 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-05bcbc21-0076-4d33-a760-aeda4ab2d2e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:09.874853 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e2fdfc12-45f1-48a6-bbfa-b462f69e30ab tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:09.879183 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-05bcbc21-0076-4d33-a760-aeda4ab2d2e2 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1724 microversion: 2.1 time: 0.218638 Jun 02 13:41:09.879747 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 334/694] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:09 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:09.882509 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e2fdfc12-45f1-48a6-bbfa-b462f69e30ab tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1664 microversion: 2.1 time: 0.208792 Jun 02 13:41:09.883238 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 361/695] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:09 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1664 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:09.886382 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d4646a68-5b3e-45a0-a90a-846944966d07 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:09.887057 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d4646a68-5b3e-45a0-a90a-846944966d07 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:09.893433 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4646a68-5b3e-45a0-a90a-846944966d07 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.893886 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4646a68-5b3e-45a0-a90a-846944966d07 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:09.894672 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4646a68-5b3e-45a0-a90a-846944966d07 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:09.895128 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4646a68-5b3e-45a0-a90a-846944966d07 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:10.020153 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d4646a68-5b3e-45a0-a90a-846944966d07 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:10.028131 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d4646a68-5b3e-45a0-a90a-846944966d07 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:10.029671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d4646a68-5b3e-45a0-a90a-846944966d07 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:10.030818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d4646a68-5b3e-45a0-a90a-846944966d07 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.150157 Jun 02 13:41:10.031368 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 335/696] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:09 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:10.592646 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-42d3108c-5a1b-46f9-892e-a37fbd84ce1b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:10.593264 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-42d3108c-5a1b-46f9-892e-a37fbd84ce1b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:10.599801 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-42d3108c-5a1b-46f9-892e-a37fbd84ce1b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:10.600253 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-42d3108c-5a1b-46f9-892e-a37fbd84ce1b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:10.601044 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-42d3108c-5a1b-46f9-892e-a37fbd84ce1b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:10.601482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-42d3108c-5a1b-46f9-892e-a37fbd84ce1b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:10.725891 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-42d3108c-5a1b-46f9-892e-a37fbd84ce1b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:10.733307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-42d3108c-5a1b-46f9-892e-a37fbd84ce1b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1365 microversion: 2.1 time: 0.144616 Jun 02 13:41:10.733873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 362/697] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:10 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:10.896626 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b5ce9382-457b-48c1-a4e4-39c2214e1ab0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:10.897270 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b5ce9382-457b-48c1-a4e4-39c2214e1ab0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:10.900672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-418068d4-5bd0-405d-bdc0-e0c84d4133c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:10.900672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-418068d4-5bd0-405d-bdc0-e0c84d4133c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:10.903660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5ce9382-457b-48c1-a4e4-39c2214e1ab0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:10.904226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5ce9382-457b-48c1-a4e4-39c2214e1ab0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:10.905131 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5ce9382-457b-48c1-a4e4-39c2214e1ab0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:10.905685 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5ce9382-457b-48c1-a4e4-39c2214e1ab0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:10.907953 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-418068d4-5bd0-405d-bdc0-e0c84d4133c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:10.908444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-418068d4-5bd0-405d-bdc0-e0c84d4133c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:10.909220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-418068d4-5bd0-405d-bdc0-e0c84d4133c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:10.909660 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-418068d4-5bd0-405d-bdc0-e0c84d4133c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:11.102873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-418068d4-5bd0-405d-bdc0-e0c84d4133c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:11.110470 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-418068d4-5bd0-405d-bdc0-e0c84d4133c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1664 microversion: 2.1 time: 0.214829 Jun 02 13:41:11.111049 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 363/698] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:10 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1664 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:11.116121 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-857af48b-0d03-431a-a47a-bce00e59c3f9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:11.116771 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-857af48b-0d03-431a-a47a-bce00e59c3f9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:11.122511 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-857af48b-0d03-431a-a47a-bce00e59c3f9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:11.122968 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-857af48b-0d03-431a-a47a-bce00e59c3f9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:11.123743 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-857af48b-0d03-431a-a47a-bce00e59c3f9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:11.124183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-857af48b-0d03-431a-a47a-bce00e59c3f9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:11.129269 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b5ce9382-457b-48c1-a4e4-39c2214e1ab0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:11.137428 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b5ce9382-457b-48c1-a4e4-39c2214e1ab0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1724 microversion: 2.1 time: 0.244833 Jun 02 13:41:11.138098 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 336/699] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:10 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:11.251482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-857af48b-0d03-431a-a47a-bce00e59c3f9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:11.259386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-857af48b-0d03-431a-a47a-bce00e59c3f9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:11.260934 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-857af48b-0d03-431a-a47a-bce00e59c3f9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:11.262094 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-857af48b-0d03-431a-a47a-bce00e59c3f9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.150131 Jun 02 13:41:11.262661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 364/700] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:11 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:11.750960 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1c210856-3a23-4017-a783-d3637f2ff842 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:11.751569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1c210856-3a23-4017-a783-d3637f2ff842 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:11.757631 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c210856-3a23-4017-a783-d3637f2ff842 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:11.758074 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c210856-3a23-4017-a783-d3637f2ff842 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:11.758824 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c210856-3a23-4017-a783-d3637f2ff842 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:11.759254 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c210856-3a23-4017-a783-d3637f2ff842 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:11.888106 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1c210856-3a23-4017-a783-d3637f2ff842 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:11.897152 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1c210856-3a23-4017-a783-d3637f2ff842 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1555 microversion: 2.1 time: 0.149996 Jun 02 13:41:11.897719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 337/701] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:11 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:11.913299 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-733ad315-4c5b-4983-b633-33d48a155961 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:11.913804 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-733ad315-4c5b-4983-b633-33d48a155961 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:11.921081 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-733ad315-4c5b-4983-b633-33d48a155961 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:11.921748 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-733ad315-4c5b-4983-b633-33d48a155961 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:11.922642 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-733ad315-4c5b-4983-b633-33d48a155961 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:11.923189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-733ad315-4c5b-4983-b633-33d48a155961 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:11.999411 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-733ad315-4c5b-4983-b633-33d48a155961 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090001 Jun 02 13:41:12.000029 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 365/702] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Jun 2 13:41:11 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:41:12.128067 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-03326651-d4e6-4856-9c55-4f924639cad5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:12.129554 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-03326651-d4e6-4856-9c55-4f924639cad5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:12.136291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03326651-d4e6-4856-9c55-4f924639cad5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:12.136769 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03326651-d4e6-4856-9c55-4f924639cad5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:12.137528 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03326651-d4e6-4856-9c55-4f924639cad5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:12.137960 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03326651-d4e6-4856-9c55-4f924639cad5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:12.154809 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8c06ac15-7a9b-4474-b5fc-66282c1e765d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:12.155430 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8c06ac15-7a9b-4474-b5fc-66282c1e765d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:12.156575 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:12.161688 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c06ac15-7a9b-4474-b5fc-66282c1e765d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:12.162135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c06ac15-7a9b-4474-b5fc-66282c1e765d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:12.162899 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c06ac15-7a9b-4474-b5fc-66282c1e765d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:12.163338 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c06ac15-7a9b-4474-b5fc-66282c1e765d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:12.445768 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-03326651-d4e6-4856-9c55-4f924639cad5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:12.450343 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8c06ac15-7a9b-4474-b5fc-66282c1e765d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:12.453565 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-03326651-d4e6-4856-9c55-4f924639cad5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1664 microversion: 2.1 time: 0.329083 Jun 02 13:41:12.454144 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 338/703] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:12 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1664 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:12.458542 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-41f6591a-7ca8-4f6c-877c-8e411aeae3d0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:12.459146 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-41f6591a-7ca8-4f6c-877c-8e411aeae3d0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:12.465165 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-41f6591a-7ca8-4f6c-877c-8e411aeae3d0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:12.465583 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-41f6591a-7ca8-4f6c-877c-8e411aeae3d0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:12.466340 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-41f6591a-7ca8-4f6c-877c-8e411aeae3d0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:12.466778 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-41f6591a-7ca8-4f6c-877c-8e411aeae3d0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:12.470086 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8c06ac15-7a9b-4474-b5fc-66282c1e765d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1724 microversion: 2.1 time: 0.319024 Jun 02 13:41:12.470788 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 366/704] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:12 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:12.970080 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-41f6591a-7ca8-4f6c-877c-8e411aeae3d0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:12.979829 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-41f6591a-7ca8-4f6c-877c-8e411aeae3d0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:12.981463 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-41f6591a-7ca8-4f6c-877c-8e411aeae3d0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:12.982694 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-41f6591a-7ca8-4f6c-877c-8e411aeae3d0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.527592 Jun 02 13:41:12.993727 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 339/705] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:12 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:13.470832 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5aae4cc0-3d47-462f-9fa8-8459110a24af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:13.471620 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5aae4cc0-3d47-462f-9fa8-8459110a24af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:13.478988 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5aae4cc0-3d47-462f-9fa8-8459110a24af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:13.479659 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5aae4cc0-3d47-462f-9fa8-8459110a24af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:13.480664 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5aae4cc0-3d47-462f-9fa8-8459110a24af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:13.481286 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5aae4cc0-3d47-462f-9fa8-8459110a24af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:13.491451 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f5c731b5-a775-41f9-8e7c-84b38a7ba2a6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:13.492803 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f5c731b5-a775-41f9-8e7c-84b38a7ba2a6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:13.503787 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5c731b5-a775-41f9-8e7c-84b38a7ba2a6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:13.504664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5c731b5-a775-41f9-8e7c-84b38a7ba2a6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:13.505664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5c731b5-a775-41f9-8e7c-84b38a7ba2a6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:13.507185 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5c731b5-a775-41f9-8e7c-84b38a7ba2a6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:13.858904 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5aae4cc0-3d47-462f-9fa8-8459110a24af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:13.867013 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5aae4cc0-3d47-462f-9fa8-8459110a24af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1664 microversion: 2.1 time: 0.399970 Jun 02 13:41:13.867681 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 367/706] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:13 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1664 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:13.902531 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f5c731b5-a775-41f9-8e7c-84b38a7ba2a6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:13.913318 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f5c731b5-a775-41f9-8e7c-84b38a7ba2a6 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1724 microversion: 2.1 time: 0.429294 Jun 02 13:41:13.914226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 340/707] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:13 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1724 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:14.004910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9ffaa8c3-d0ae-4786-a128-15ad5f25bb8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:14.006059 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9ffaa8c3-d0ae-4786-a128-15ad5f25bb8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:14.030777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ffaa8c3-d0ae-4786-a128-15ad5f25bb8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:14.031335 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ffaa8c3-d0ae-4786-a128-15ad5f25bb8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:14.032224 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ffaa8c3-d0ae-4786-a128-15ad5f25bb8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:14.032782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ffaa8c3-d0ae-4786-a128-15ad5f25bb8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:14.085547 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-fdb513e7-39cc-4290-aa87-f5e444892e70 req-89f8594a-9a7a-474c-b918-43d53998ae7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d660d9e5-4816-47f4-b60a-922f53b35cd2", "tag": "134a0cd2-dac2-45ac-9b9d-f77942327b3a"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:14.094540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-fdb513e7-39cc-4290-aa87-f5e444892e70 req-89f8594a-9a7a-474c-b918-43d53998ae7e service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:14.095179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-fdb513e7-39cc-4290-aa87-f5e444892e70 req-89f8594a-9a7a-474c-b918-43d53998ae7e service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:14.108474 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-fdb513e7-39cc-4290-aa87-f5e444892e70 req-89f8594a-9a7a-474c-b918-43d53998ae7e service nova] Creating event network-changed:134a0cd2-dac2-45ac-9b9d-f77942327b3a for instance d660d9e5-4816-47f4-b60a-922f53b35cd2 on hv-cinder-83608 Jun 02 13:41:14.115162 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-fdb513e7-39cc-4290-aa87-f5e444892e70 req-89f8594a-9a7a-474c-b918-43d53998ae7e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033462 Jun 02 13:41:14.115978 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 341/708] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:41:14.310024 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9ffaa8c3-d0ae-4786-a128-15ad5f25bb8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:14.318114 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9ffaa8c3-d0ae-4786-a128-15ad5f25bb8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:14.319684 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9ffaa8c3-d0ae-4786-a128-15ad5f25bb8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:14.321297 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9ffaa8c3-d0ae-4786-a128-15ad5f25bb8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1724 microversion: 2.20 time: 0.323310 Jun 02 13:41:14.322979 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 368/709] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:13 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:14.886148 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-745a1692-9bce-482e-9dfc-9870fd258711 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:14.886855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-745a1692-9bce-482e-9dfc-9870fd258711 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:14.893371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-745a1692-9bce-482e-9dfc-9870fd258711 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:14.894560 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-745a1692-9bce-482e-9dfc-9870fd258711 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:14.895371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-745a1692-9bce-482e-9dfc-9870fd258711 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:14.895813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-745a1692-9bce-482e-9dfc-9870fd258711 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:14.931414 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9e9bc7a1-0a57-4074-b88a-49cfc0cc3396 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:14.932029 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9e9bc7a1-0a57-4074-b88a-49cfc0cc3396 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:14.938900 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9e9bc7a1-0a57-4074-b88a-49cfc0cc3396 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:14.939625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9e9bc7a1-0a57-4074-b88a-49cfc0cc3396 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:14.941202 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9e9bc7a1-0a57-4074-b88a-49cfc0cc3396 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:14.941857 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9e9bc7a1-0a57-4074-b88a-49cfc0cc3396 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:15.091263 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-745a1692-9bce-482e-9dfc-9870fd258711 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:15.099462 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-745a1692-9bce-482e-9dfc-9870fd258711 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1664 microversion: 2.1 time: 0.218159 Jun 02 13:41:15.110313 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 342/710] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:14 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1664 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:15.127051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9e9bc7a1-0a57-4074-b88a-49cfc0cc3396 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:15.135964 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9e9bc7a1-0a57-4074-b88a-49cfc0cc3396 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1724 microversion: 2.1 time: 0.208870 Jun 02 13:41:15.136837 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 369/711] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:14 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:15.340291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6dcba9ac-1518-44e8-8794-6646e3a3d924 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:15.340966 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6dcba9ac-1518-44e8-8794-6646e3a3d924 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:15.350026 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6dcba9ac-1518-44e8-8794-6646e3a3d924 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:15.350487 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6dcba9ac-1518-44e8-8794-6646e3a3d924 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:15.351267 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6dcba9ac-1518-44e8-8794-6646e3a3d924 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:15.351705 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6dcba9ac-1518-44e8-8794-6646e3a3d924 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:15.415317 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6dcba9ac-1518-44e8-8794-6646e3a3d924 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:15.424620 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6dcba9ac-1518-44e8-8794-6646e3a3d924 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:15.426673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6dcba9ac-1518-44e8-8794-6646e3a3d924 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:15.427826 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6dcba9ac-1518-44e8-8794-6646e3a3d924 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1656 microversion: 2.20 time: 0.091532 Jun 02 13:41:15.428409 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 343/712] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:15 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:16.117386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6ee5183f-670e-49ac-b086-8cf228b8a8c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:16.118002 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6ee5183f-670e-49ac-b086-8cf228b8a8c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:16.124567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6ee5183f-670e-49ac-b086-8cf228b8a8c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:16.125021 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6ee5183f-670e-49ac-b086-8cf228b8a8c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:16.126153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6ee5183f-670e-49ac-b086-8cf228b8a8c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:16.126253 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6ee5183f-670e-49ac-b086-8cf228b8a8c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:16.135709 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-cc4fbd07-4bf8-430e-bfc4-d51770604a99 req-8b63a46c-d8e5-42c3-a696-9b9f8cc5be2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf15208f-0bda-407c-8ea0-38a1300bfa16", "name": "network-vif-deleted", "tag": "8aab5ca9-b3de-4176-a679-2976edeca505"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:16.144821 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cc4fbd07-4bf8-430e-bfc4-d51770604a99 req-8b63a46c-d8e5-42c3-a696-9b9f8cc5be2c service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:16.145375 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cc4fbd07-4bf8-430e-bfc4-d51770604a99 req-8b63a46c-d8e5-42c3-a696-9b9f8cc5be2c service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:16.156906 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-cc4fbd07-4bf8-430e-bfc4-d51770604a99 req-8b63a46c-d8e5-42c3-a696-9b9f8cc5be2c service nova] Creating event network-vif-deleted:8aab5ca9-b3de-4176-a679-2976edeca505 for instance bf15208f-0bda-407c-8ea0-38a1300bfa16 on hv-cinder-83608 Jun 02 13:41:16.162290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-cc4fbd07-4bf8-430e-bfc4-d51770604a99 req-8b63a46c-d8e5-42c3-a696-9b9f8cc5be2c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030199 Jun 02 13:41:16.162885 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 344/713] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:41:16.167785 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aab6dddd-245d-4496-a523-d1d1d14ada95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:16.168508 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aab6dddd-245d-4496-a523-d1d1d14ada95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:16.174701 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aab6dddd-245d-4496-a523-d1d1d14ada95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:16.175159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aab6dddd-245d-4496-a523-d1d1d14ada95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:16.175937 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aab6dddd-245d-4496-a523-d1d1d14ada95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:16.176414 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aab6dddd-245d-4496-a523-d1d1d14ada95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:16.306761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6ee5183f-670e-49ac-b086-8cf228b8a8c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:16.316276 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6ee5183f-670e-49ac-b086-8cf228b8a8c4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1664 microversion: 2.1 time: 0.202271 Jun 02 13:41:16.316967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 370/714] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:16 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1664 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:16.342295 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-aab6dddd-245d-4496-a523-d1d1d14ada95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:16.350374 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-aab6dddd-245d-4496-a523-d1d1d14ada95 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1724 microversion: 2.1 time: 0.186407 Jun 02 13:41:16.350937 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 345/715] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:16 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:16.446736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e407bbe4-b359-4be6-baf9-c8e20c900b61 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:16.447379 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e407bbe4-b359-4be6-baf9-c8e20c900b61 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:16.453778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e407bbe4-b359-4be6-baf9-c8e20c900b61 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:16.454228 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e407bbe4-b359-4be6-baf9-c8e20c900b61 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:16.454991 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e407bbe4-b359-4be6-baf9-c8e20c900b61 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:16.455427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e407bbe4-b359-4be6-baf9-c8e20c900b61 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:16.474729 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:16.519869 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e407bbe4-b359-4be6-baf9-c8e20c900b61 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:16.528576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e407bbe4-b359-4be6-baf9-c8e20c900b61 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:16.530292 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e407bbe4-b359-4be6-baf9-c8e20c900b61 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:16.531469 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e407bbe4-b359-4be6-baf9-c8e20c900b61 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1366 microversion: 2.20 time: 0.088579 Jun 02 13:41:16.532026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 371/716] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:16 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1366 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:17.333844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b756a620-3f4b-4105-b280-b14fb2a638e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:17.334470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b756a620-3f4b-4105-b280-b14fb2a638e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:17.340998 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b756a620-3f4b-4105-b280-b14fb2a638e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:17.341447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b756a620-3f4b-4105-b280-b14fb2a638e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:17.342216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b756a620-3f4b-4105-b280-b14fb2a638e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:17.342654 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b756a620-3f4b-4105-b280-b14fb2a638e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:17.367454 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6d4cec5a-24b9-4929-8cce-26cbb055fd9f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:17.368089 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6d4cec5a-24b9-4929-8cce-26cbb055fd9f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:17.374731 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d4cec5a-24b9-4929-8cce-26cbb055fd9f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:17.375183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d4cec5a-24b9-4929-8cce-26cbb055fd9f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:17.375949 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d4cec5a-24b9-4929-8cce-26cbb055fd9f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:17.376413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6d4cec5a-24b9-4929-8cce-26cbb055fd9f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:17.527482 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b756a620-3f4b-4105-b280-b14fb2a638e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:17.535734 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b756a620-3f4b-4105-b280-b14fb2a638e5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1668 microversion: 2.1 time: 0.205778 Jun 02 13:41:17.536325 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 346/717] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:17 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1668 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:41:17.548329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:17.548934 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:17.553444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6d4cec5a-24b9-4929-8cce-26cbb055fd9f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:17.555026 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:17.555483 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:17.556248 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:17.556715 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:17.561467 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6d4cec5a-24b9-4929-8cce-26cbb055fd9f tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1730 microversion: 2.1 time: 0.197799 Jun 02 13:41:17.562033 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 372/718] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:41:17 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:41:17.577395 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9dd52f13-b03c-4491-ac9c-8355caa72507 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:17.577896 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9dd52f13-b03c-4491-ac9c-8355caa72507 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:17.584783 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9dd52f13-b03c-4491-ac9c-8355caa72507 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:17.585004 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9dd52f13-b03c-4491-ac9c-8355caa72507 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:17.585778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9dd52f13-b03c-4491-ac9c-8355caa72507 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:17.586217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9dd52f13-b03c-4491-ac9c-8355caa72507 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:17.590210 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:17.590735 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:17.591263 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lazy-loading 'fault' on Instance uuid bf15208f-0bda-407c-8ea0-38a1300bfa16 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:41:17.640623 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:17.649350 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:17.650867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:17.652021 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-25dba09f-03d2-4776-a464-439e39fd3287 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1371 microversion: 2.20 time: 0.107418 Jun 02 13:41:17.652613 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 347/719] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:17 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:41:17.677384 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9dd52f13-b03c-4491-ac9c-8355caa72507 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103629 Jun 02 13:41:17.677982 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 373/720] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Jun 2 13:41:17 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:41:18.671050 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:18.671614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:18.678719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:18.679165 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:18.679922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:18.680389 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:18.745289 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-d47dfeb0-efea-4d2c-abc7-3fb664b017c2 req-b175abf7-8260-4972-9e93-514a7fbf98ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8851d9-9e33-4d8f-b120-f3b71a4f44a0", "tag": "331888dc-5e0f-4a52-be55-4b6a38503c9d"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:18.754310 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-d47dfeb0-efea-4d2c-abc7-3fb664b017c2 req-b175abf7-8260-4972-9e93-514a7fbf98ae service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:18.755113 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-d47dfeb0-efea-4d2c-abc7-3fb664b017c2 req-b175abf7-8260-4972-9e93-514a7fbf98ae service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:18.767577 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-d47dfeb0-efea-4d2c-abc7-3fb664b017c2 req-b175abf7-8260-4972-9e93-514a7fbf98ae service nova] Creating event network-changed:331888dc-5e0f-4a52-be55-4b6a38503c9d for instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 on hv-cinder-83608 Jun 02 13:41:18.774736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-d47dfeb0-efea-4d2c-abc7-3fb664b017c2 req-b175abf7-8260-4972-9e93-514a7fbf98ae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033796 Jun 02 13:41:18.775976 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 374/721] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:41:18.883073 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:18.883523 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:18.884133 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lazy-loading 'fault' on Instance uuid bf15208f-0bda-407c-8ea0-38a1300bfa16 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:41:18.965322 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:18.975083 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:18.981311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:18.984525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-eb61216a-1f7f-4f1a-bb82-64baafc4838e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 200 len: 1371 microversion: 2.20 time: 0.317444 Jun 02 13:41:18.987160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 348/722] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:18 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:20.004454 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a707b7db-8bac-4e4b-92de-02e955fc37eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:20.005300 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a707b7db-8bac-4e4b-92de-02e955fc37eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:20.011477 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a707b7db-8bac-4e4b-92de-02e955fc37eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:20.011933 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a707b7db-8bac-4e4b-92de-02e955fc37eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:20.012755 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a707b7db-8bac-4e4b-92de-02e955fc37eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:20.013202 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a707b7db-8bac-4e4b-92de-02e955fc37eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:20.026746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-a707b7db-8bac-4e4b-92de-02e955fc37eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] HTTP exception thrown: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a707b7db-8bac-4e4b-92de-02e955fc37eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Request method failure captured: Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 HTTP/1.1 Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzbvSGfosj-rWtsFuiX_rU9A2m98kW1MgwJEi0KIcrNgT5YAPGEquRQAOdnMmNmXJd17U0W_GONeAwZ1VNjdltAOlJKDuGtsDYEQxJJhv-Xtd32UGfUcIvChbZpJK2Fubj9-GlcBkjmHltpZxbAP9uqqf9h2xrVABwuxF5eYueZCkk Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:41:20.028413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}] Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 88bc03c141d64772b606e087d86e973e Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:41:20.030123 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'bf15208f-0bda-407c-8ea0-38a1300bfa16'} Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:41:20.031170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:41:20.032706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:41:20.034698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a707b7db-8bac-4e4b-92de-02e955fc37eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Returning 404 to user: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:41:20.034698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a707b7db-8bac-4e4b-92de-02e955fc37eb tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 404 len: 111 microversion: 2.20 time: 0.030806 Jun 02 13:41:20.034698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 375/723] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:19 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:41:20.039275 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9876b1a1-d2b0-4bb3-8688-99f2fcacb39d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '.version_select at 0x7f861a29b8b0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:20.056234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9876b1a1-d2b0-4bb3-8688-99f2fcacb39d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902643147" status: 204 len: 0 microversion: 2.20 time: 0.020754 Jun 02 13:41:20.056833 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 349/724] 10.222.0.32 () {60 vars in 1261 bytes} [Thu Jun 2 13:41:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902643147 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 13:41:20.672993 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c5b27a4f-ccdc-4d64-af43-41d60a191e34 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Action: 'create', calling method: .version_select at 0x7f861509f940>, body: {"keypair": {"name": "tempest-keypair-1500762851", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpRWYZS02xmhWcAQorj2m6YUF304HAQEKYGl7tr8TnNeZZgjL6Om4URmHAKdx1xBHvDDcrFA8thQCzFMJzzUn3hcH+Qcg8WURJgZ/QsU6VMQuEZyZ4ftj8HDFXH5CtIxg=="}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:20.686602 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-c5b27a4f-ccdc-4d64-af43-41d60a191e34 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Getting quotas for project 8e9e2d5c93274eb781bd76912178bae6. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:41:20.690367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-c5b27a4f-ccdc-4d64-af43-41d60a191e34 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Getting quotas for user 88bc03c141d64772b606e087d86e973e and project 8e9e2d5c93274eb781bd76912178bae6. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:41:20.712190 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c5b27a4f-ccdc-4d64-af43-41d60a191e34 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043112 Jun 02 13:41:20.712801 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 376/725] 10.222.0.32 () {62 vars in 1199 bytes} [Thu Jun 2 13:41:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 44 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 13:41:20.839950 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-d8fb583c-4f51-494b-b2cf-a952f205cbe3 req-4336038b-04b6-4936-b424-b541e022438d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8851d9-9e33-4d8f-b120-f3b71a4f44a0", "tag": "331888dc-5e0f-4a52-be55-4b6a38503c9d"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:20.847898 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d8fb583c-4f51-494b-b2cf-a952f205cbe3 req-4336038b-04b6-4936-b424-b541e022438d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:20.848363 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d8fb583c-4f51-494b-b2cf-a952f205cbe3 req-4336038b-04b6-4936-b424-b541e022438d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:20.859540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-d8fb583c-4f51-494b-b2cf-a952f205cbe3 req-4336038b-04b6-4936-b424-b541e022438d service nova] Creating event network-changed:331888dc-5e0f-4a52-be55-4b6a38503c9d for instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 on hv-cinder-83608 Jun 02 13:41:20.864551 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-d8fb583c-4f51-494b-b2cf-a952f205cbe3 req-4336038b-04b6-4936-b424-b541e022438d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028548 Jun 02 13:41:20.865447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 350/726] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:41:22.026498 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1572676872", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20bf99c3-c1f6-40c9-b149-35408e01ced9"}], "security_groups": [{"name": "tempest-securitygroup--2020159451"}], "key_name": "tempest-keypair-1500762851", "user_data": "}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:22.125025 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] validate_networks() for [('20bf99c3-c1f6-40c9-b149-35408e01ced9', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:41:22.487808 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:41:22.488244 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:41:22.488754 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:41:22.489174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:41:22.489598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:41:22.498367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:22.498820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:22.499636 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:22.500077 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:22.516934 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Getting quotas for project 8e9e2d5c93274eb781bd76912178bae6. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:41:22.521544 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Getting quotas for user 88bc03c141d64772b606e087d86e973e and project 8e9e2d5c93274eb781bd76912178bae6. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:41:22.532426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:41:22.534690 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:41:22.545737 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:22.579925 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-401a9399-69be-410d-8e17-a7d9cc973c42 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.558301 Jun 02 13:41:22.580620 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 377/727] 10.222.0.32 () {62 vars in 1187 bytes} [Thu Jun 2 13:41:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 13:41:22.592411 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9ddcfc07-de8b-4852-9664-d7bddf4c808c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:22.594000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9ddcfc07-de8b-4852-9664-d7bddf4c808c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:22.648881 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9ddcfc07-de8b-4852-9664-d7bddf4c808c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:22.656245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9ddcfc07-de8b-4852-9664-d7bddf4c808c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:22.657779 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9ddcfc07-de8b-4852-9664-d7bddf4c808c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:22.658920 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9ddcfc07-de8b-4852-9664-d7bddf4c808c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1282 microversion: 2.20 time: 0.071341 Jun 02 13:41:22.659543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 351/728] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:22 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:23.678168 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-544649d9-1da2-4087-83ed-3ea00fbd84cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:23.678776 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-544649d9-1da2-4087-83ed-3ea00fbd84cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:23.685533 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-544649d9-1da2-4087-83ed-3ea00fbd84cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:23.685982 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-544649d9-1da2-4087-83ed-3ea00fbd84cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:23.686741 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-544649d9-1da2-4087-83ed-3ea00fbd84cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:23.687180 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-544649d9-1da2-4087-83ed-3ea00fbd84cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:23.750857 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-544649d9-1da2-4087-83ed-3ea00fbd84cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:23.759420 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-544649d9-1da2-4087-83ed-3ea00fbd84cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:23.760949 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-544649d9-1da2-4087-83ed-3ea00fbd84cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:23.762043 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-544649d9-1da2-4087-83ed-3ea00fbd84cd tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1334 microversion: 2.20 time: 0.088847 Jun 02 13:41:23.762786 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 378/729] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:23 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:24.782443 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-40a84394-0d8e-430a-8909-6b646539e51f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:24.783091 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-40a84394-0d8e-430a-8909-6b646539e51f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:24.791301 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40a84394-0d8e-430a-8909-6b646539e51f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:24.792133 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40a84394-0d8e-430a-8909-6b646539e51f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:24.793215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40a84394-0d8e-430a-8909-6b646539e51f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:24.793689 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40a84394-0d8e-430a-8909-6b646539e51f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:24.930083 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-40a84394-0d8e-430a-8909-6b646539e51f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:24.938923 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-40a84394-0d8e-430a-8909-6b646539e51f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:24.940539 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-40a84394-0d8e-430a-8909-6b646539e51f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:24.941641 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-40a84394-0d8e-430a-8909-6b646539e51f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1408 microversion: 2.20 time: 0.164467 Jun 02 13:41:24.942189 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 352/730] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:24 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:25.388653 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-4ef911eb-8b5d-47ba-9dfe-4bba3611b130 req-78e0a051-975e-4e35-a158-a506e77a957d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5608f7cb-9e96-4916-87e2-1f6efd94cae1", "tag": "081d1d87-4ea1-402c-a462-22f03273d76c"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:25.404065 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-4ef911eb-8b5d-47ba-9dfe-4bba3611b130 req-78e0a051-975e-4e35-a158-a506e77a957d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:25.404329 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-4ef911eb-8b5d-47ba-9dfe-4bba3611b130 req-78e0a051-975e-4e35-a158-a506e77a957d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:25.416455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-4ef911eb-8b5d-47ba-9dfe-4bba3611b130 req-78e0a051-975e-4e35-a158-a506e77a957d service nova] Creating event network-changed:081d1d87-4ea1-402c-a462-22f03273d76c for instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 on hv-cinder-83608 Jun 02 13:41:25.421334 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-4ef911eb-8b5d-47ba-9dfe-4bba3611b130 req-78e0a051-975e-4e35-a158-a506e77a957d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036341 Jun 02 13:41:25.421968 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 379/731] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:41:25.959413 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2682aac3-8999-4478-89a5-bf21aecd900c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:25.959980 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2682aac3-8999-4478-89a5-bf21aecd900c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:25.966474 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2682aac3-8999-4478-89a5-bf21aecd900c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:25.966930 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2682aac3-8999-4478-89a5-bf21aecd900c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:25.967696 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2682aac3-8999-4478-89a5-bf21aecd900c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:25.968133 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2682aac3-8999-4478-89a5-bf21aecd900c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:26.095531 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2682aac3-8999-4478-89a5-bf21aecd900c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:26.104100 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2682aac3-8999-4478-89a5-bf21aecd900c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:26.105646 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2682aac3-8999-4478-89a5-bf21aecd900c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:26.106752 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2682aac3-8999-4478-89a5-bf21aecd900c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1408 microversion: 2.20 time: 0.151402 Jun 02 13:41:26.107380 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 353/732] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:25 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:27.125637 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e88734cb-2b37-4c68-b2b0-0e7a6e0190a9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:27.126330 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e88734cb-2b37-4c68-b2b0-0e7a6e0190a9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:27.133642 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e88734cb-2b37-4c68-b2b0-0e7a6e0190a9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:27.134088 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e88734cb-2b37-4c68-b2b0-0e7a6e0190a9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:27.134841 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e88734cb-2b37-4c68-b2b0-0e7a6e0190a9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:27.135276 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e88734cb-2b37-4c68-b2b0-0e7a6e0190a9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:27.313239 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e88734cb-2b37-4c68-b2b0-0e7a6e0190a9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:27.321715 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e88734cb-2b37-4c68-b2b0-0e7a6e0190a9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:27.323215 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e88734cb-2b37-4c68-b2b0-0e7a6e0190a9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:27.324321 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e88734cb-2b37-4c68-b2b0-0e7a6e0190a9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1408 microversion: 2.20 time: 0.202942 Jun 02 13:41:27.324884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 380/733] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:27 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:28.342476 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-98410286-5ab6-47a9-b342-9e8c6f1fa2d1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:28.343086 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-98410286-5ab6-47a9-b342-9e8c6f1fa2d1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:28.349797 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-98410286-5ab6-47a9-b342-9e8c6f1fa2d1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:28.350243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-98410286-5ab6-47a9-b342-9e8c6f1fa2d1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:28.350998 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-98410286-5ab6-47a9-b342-9e8c6f1fa2d1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:28.351430 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-98410286-5ab6-47a9-b342-9e8c6f1fa2d1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:28.478611 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-98410286-5ab6-47a9-b342-9e8c6f1fa2d1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:28.486722 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-98410286-5ab6-47a9-b342-9e8c6f1fa2d1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:28.488496 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-98410286-5ab6-47a9-b342-9e8c6f1fa2d1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:28.489674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-98410286-5ab6-47a9-b342-9e8c6f1fa2d1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1408 microversion: 2.20 time: 0.151071 Jun 02 13:41:28.490290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 354/734] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:28 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:29.507061 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-51e34f91-9270-47a1-9278-5bc85a92e558 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:29.507705 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-51e34f91-9270-47a1-9278-5bc85a92e558 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:29.514211 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51e34f91-9270-47a1-9278-5bc85a92e558 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:29.514666 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51e34f91-9270-47a1-9278-5bc85a92e558 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:29.515431 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51e34f91-9270-47a1-9278-5bc85a92e558 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:29.515869 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-51e34f91-9270-47a1-9278-5bc85a92e558 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:29.644802 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-51e34f91-9270-47a1-9278-5bc85a92e558 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:29.652695 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-51e34f91-9270-47a1-9278-5bc85a92e558 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:29.654198 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-51e34f91-9270-47a1-9278-5bc85a92e558 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:29.655296 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-51e34f91-9270-47a1-9278-5bc85a92e558 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1408 microversion: 2.20 time: 0.152203 Jun 02 13:41:29.655853 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 381/735] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:29 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:30.551539 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-e58dd47d-7fd2-4501-97d1-2d207ec05b16 req-80555640-e149-4235-9264-996216a915fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5608f7cb-9e96-4916-87e2-1f6efd94cae1", "name": "network-vif-plugged", "status": "completed", "tag": "081d1d87-4ea1-402c-a462-22f03273d76c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:30.560271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-e58dd47d-7fd2-4501-97d1-2d207ec05b16 req-80555640-e149-4235-9264-996216a915fd service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:30.560753 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-e58dd47d-7fd2-4501-97d1-2d207ec05b16 req-80555640-e149-4235-9264-996216a915fd service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:30.572114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-e58dd47d-7fd2-4501-97d1-2d207ec05b16 req-80555640-e149-4235-9264-996216a915fd service nova] Creating event network-vif-plugged:081d1d87-4ea1-402c-a462-22f03273d76c for instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 on hv-cinder-83608 Jun 02 13:41:30.577152 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-e58dd47d-7fd2-4501-97d1-2d207ec05b16 req-80555640-e149-4235-9264-996216a915fd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030009 Jun 02 13:41:30.577835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 355/736] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:41:30.674066 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-afb591f4-ca09-4365-804a-3e8537ad8110 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:30.675162 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-afb591f4-ca09-4365-804a-3e8537ad8110 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:30.681816 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-afb591f4-ca09-4365-804a-3e8537ad8110 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:30.682274 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-afb591f4-ca09-4365-804a-3e8537ad8110 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:30.683051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-afb591f4-ca09-4365-804a-3e8537ad8110 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:30.683494 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-afb591f4-ca09-4365-804a-3e8537ad8110 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:30.813106 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-afb591f4-ca09-4365-804a-3e8537ad8110 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:30.820983 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-afb591f4-ca09-4365-804a-3e8537ad8110 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:30.822482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-afb591f4-ca09-4365-804a-3e8537ad8110 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:30.823668 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-afb591f4-ca09-4365-804a-3e8537ad8110 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1408 microversion: 2.20 time: 0.153650 Jun 02 13:41:30.824898 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 382/737] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:30 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:31.843055 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-caf52cb0-638d-4918-8892-3086c5104012 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:31.843791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-caf52cb0-638d-4918-8892-3086c5104012 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:31.850013 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-caf52cb0-638d-4918-8892-3086c5104012 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:31.850466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-caf52cb0-638d-4918-8892-3086c5104012 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:31.851232 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-caf52cb0-638d-4918-8892-3086c5104012 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:31.851679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-caf52cb0-638d-4918-8892-3086c5104012 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:31.987190 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-caf52cb0-638d-4918-8892-3086c5104012 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:31.995792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-caf52cb0-638d-4918-8892-3086c5104012 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:31.997329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-caf52cb0-638d-4918-8892-3086c5104012 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:31.998431 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-caf52cb0-638d-4918-8892-3086c5104012 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1408 microversion: 2.20 time: 0.160118 Jun 02 13:41:31.999546 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 356/738] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:31 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:33.016812 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3c2b4de7-0a20-4700-a107-a3d59076ef9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:33.017418 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3c2b4de7-0a20-4700-a107-a3d59076ef9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:33.020559 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:33.021278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=10 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:33.027378 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3c2b4de7-0a20-4700-a107-a3d59076ef9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:33.027864 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3c2b4de7-0a20-4700-a107-a3d59076ef9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:33.028685 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3c2b4de7-0a20-4700-a107-a3d59076ef9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:33.029122 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3c2b4de7-0a20-4700-a107-a3d59076ef9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:33.171215 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3c2b4de7-0a20-4700-a107-a3d59076ef9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:33.180775 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3c2b4de7-0a20-4700-a107-a3d59076ef9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:33.182278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3c2b4de7-0a20-4700-a107-a3d59076ef9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:33.183831 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3c2b4de7-0a20-4700-a107-a3d59076ef9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1408 microversion: 2.20 time: 0.170904 Jun 02 13:41:33.184407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 383/739] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:33 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:34.202593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-66c8231c-c43b-4658-9ccf-8f23bec510de tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:34.203462 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-66c8231c-c43b-4658-9ccf-8f23bec510de tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:34.205470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:34.206595 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:34.212883 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66c8231c-c43b-4658-9ccf-8f23bec510de tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:34.213330 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66c8231c-c43b-4658-9ccf-8f23bec510de tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:34.214087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66c8231c-c43b-4658-9ccf-8f23bec510de tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:34.214522 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66c8231c-c43b-4658-9ccf-8f23bec510de tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:34.341899 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66c8231c-c43b-4658-9ccf-8f23bec510de tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:34.349782 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66c8231c-c43b-4658-9ccf-8f23bec510de tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:34.351335 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66c8231c-c43b-4658-9ccf-8f23bec510de tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:41:34.352490 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-66c8231c-c43b-4658-9ccf-8f23bec510de tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1600 microversion: 2.20 time: 0.153875 Jun 02 13:41:34.353032 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 357/740] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:41:34 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:41:34.369678 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-dd9166b7-03da-4728-8ea6-b1b1f8dad867 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:34.370165 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-dd9166b7-03da-4728-8ea6-b1b1f8dad867 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:34.376638 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd9166b7-03da-4728-8ea6-b1b1f8dad867 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:34.377097 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd9166b7-03da-4728-8ea6-b1b1f8dad867 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:34.377869 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd9166b7-03da-4728-8ea6-b1b1f8dad867 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:34.378315 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd9166b7-03da-4728-8ea6-b1b1f8dad867 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:34.458488 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-dd9166b7-03da-4728-8ea6-b1b1f8dad867 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092598 Jun 02 13:41:34.459089 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 384/741] 10.222.0.32 () {60 vars in 1315 bytes} [Thu Jun 2 13:41:34 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:41:35.581164 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-6c743ed3-d9ae-45a0-b3b9-0f03a2395d8e req-d3b1cdf4-3ff6-4ed6-86e6-658e2fce89d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5608f7cb-9e96-4916-87e2-1f6efd94cae1", "tag": "081d1d87-4ea1-402c-a462-22f03273d76c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:35.590653 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-6c743ed3-d9ae-45a0-b3b9-0f03a2395d8e req-d3b1cdf4-3ff6-4ed6-86e6-658e2fce89d9 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:35.591100 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-6c743ed3-d9ae-45a0-b3b9-0f03a2395d8e req-d3b1cdf4-3ff6-4ed6-86e6-658e2fce89d9 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:35.602830 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-6c743ed3-d9ae-45a0-b3b9-0f03a2395d8e req-d3b1cdf4-3ff6-4ed6-86e6-658e2fce89d9 service nova] Creating event network-changed:081d1d87-4ea1-402c-a462-22f03273d76c for instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 on hv-cinder-83608 Jun 02 13:41:35.607804 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-6c743ed3-d9ae-45a0-b3b9-0f03a2395d8e req-d3b1cdf4-3ff6-4ed6-86e6-658e2fce89d9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030543 Jun 02 13:41:35.608730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 358/742] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:41:56.540775 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=14 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:56.541510 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=54 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:56.545893 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-55bc6429-63d9-454e-b75c-caf3b8a90f47 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-286939575"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:56.546425 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-55bc6429-63d9-454e-b75c-caf3b8a90f47 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:56.554650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-55bc6429-63d9-454e-b75c-caf3b8a90f47 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:56.555097 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-55bc6429-63d9-454e-b75c-caf3b8a90f47 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:56.555852 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-55bc6429-63d9-454e-b75c-caf3b8a90f47 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:56.556287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-55bc6429-63d9-454e-b75c-caf3b8a90f47 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:56.679922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.network.security_group_api [None req-55bc6429-63d9-454e-b75c-caf3b8a90f47 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Removing security group 31056403-c1b8-411f-99a5-eb1b2b382769 from port 46bae571-c4cf-494a-ae5d-a0def33d7330 Jun 02 13:41:57.051503 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-55bc6429-63d9-454e-b75c-caf3b8a90f47 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "POST /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/action" status: 202 len: 0 microversion: 2.1 time: 0.512077 Jun 02 13:41:57.052352 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 385/743] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:41:56 2022] POST /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:41:57.062121 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:57.063573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=94 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:41:57.142459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-7ab1c92c-0fc2-4e61-92fc-2ad7e78b79d9 req-26f9b5b0-b964-4fdb-aaa4-26160c7611fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2071a11-86aa-4a7f-962c-709f94eb7d6b", "tag": "46bae571-c4cf-494a-ae5d-a0def33d7330"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:57.154978 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-7ab1c92c-0fc2-4e61-92fc-2ad7e78b79d9 req-26f9b5b0-b964-4fdb-aaa4-26160c7611fc service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:57.155785 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-7ab1c92c-0fc2-4e61-92fc-2ad7e78b79d9 req-26f9b5b0-b964-4fdb-aaa4-26160c7611fc service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:57.168371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-7ab1c92c-0fc2-4e61-92fc-2ad7e78b79d9 req-26f9b5b0-b964-4fdb-aaa4-26160c7611fc service nova] Creating event network-changed:46bae571-c4cf-494a-ae5d-a0def33d7330 for instance e2071a11-86aa-4a7f-962c-709f94eb7d6b on hv-cinder-83608 Jun 02 13:41:57.178344 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-7ab1c92c-0fc2-4e61-92fc-2ad7e78b79d9 req-26f9b5b0-b964-4fdb-aaa4-26160c7611fc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121227 Jun 02 13:41:57.179925 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 359/744] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:41:58.168246 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-671bb852-ac6b-4607-8868-5068a57055e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:58.168775 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-671bb852-ac6b-4607-8868-5068a57055e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:58.174890 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-671bb852-ac6b-4607-8868-5068a57055e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:58.175341 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-671bb852-ac6b-4607-8868-5068a57055e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:58.177030 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-671bb852-ac6b-4607-8868-5068a57055e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:58.177471 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-671bb852-ac6b-4607-8868-5068a57055e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:58.257526 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-671bb852-ac6b-4607-8868-5068a57055e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lazy-loading 'services' on Instance uuid e2071a11-86aa-4a7f-962c-709f94eb7d6b {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:41:58.329784 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-671bb852-ac6b-4607-8868-5068a57055e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments/bd472988-c457-4d6f-8c03-3a6065473483" status: 202 len: 0 microversion: 2.1 time: 0.165847 Jun 02 13:41:58.330547 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 386/745] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:41:58 2022] DELETE /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments/bd472988-c457-4d6f-8c03-3a6065473483 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:41:58.340570 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-363dda61-aee4-4556-b3a4-df422ed7ed1a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:58.341807 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-363dda61-aee4-4556-b3a4-df422ed7ed1a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:58.349176 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-363dda61-aee4-4556-b3a4-df422ed7ed1a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:58.349915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-363dda61-aee4-4556-b3a4-df422ed7ed1a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:58.350680 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-363dda61-aee4-4556-b3a4-df422ed7ed1a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:58.351271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-363dda61-aee4-4556-b3a4-df422ed7ed1a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:58.381462 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-363dda61-aee4-4556-b3a4-df422ed7ed1a tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045566 Jun 02 13:41:58.382028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 360/746] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:41:58 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:41:59.193552 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-de7aec1d-c72c-47d6-82c0-682b6f0e55b5 req-f562a4d1-0856-4edf-9a60-33eaaa0806b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2071a11-86aa-4a7f-962c-709f94eb7d6b", "tag": "46bae571-c4cf-494a-ae5d-a0def33d7330"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:41:59.202339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-de7aec1d-c72c-47d6-82c0-682b6f0e55b5 req-f562a4d1-0856-4edf-9a60-33eaaa0806b7 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:59.203047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-de7aec1d-c72c-47d6-82c0-682b6f0e55b5 req-f562a4d1-0856-4edf-9a60-33eaaa0806b7 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:59.213980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-de7aec1d-c72c-47d6-82c0-682b6f0e55b5 req-f562a4d1-0856-4edf-9a60-33eaaa0806b7 service nova] Creating event network-changed:46bae571-c4cf-494a-ae5d-a0def33d7330 for instance e2071a11-86aa-4a7f-962c-709f94eb7d6b on hv-cinder-83608 Jun 02 13:41:59.218827 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-de7aec1d-c72c-47d6-82c0-682b6f0e55b5 req-f562a4d1-0856-4edf-9a60-33eaaa0806b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029354 Jun 02 13:41:59.219383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 387/747] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:41:59.393296 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-96f09bc6-27b9-4782-b7f1-2d8306aee103 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:59.394949 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-96f09bc6-27b9-4782-b7f1-2d8306aee103 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:59.401284 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96f09bc6-27b9-4782-b7f1-2d8306aee103 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:59.401741 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96f09bc6-27b9-4782-b7f1-2d8306aee103 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:59.402501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96f09bc6-27b9-4782-b7f1-2d8306aee103 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:59.402968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96f09bc6-27b9-4782-b7f1-2d8306aee103 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:59.431267 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-96f09bc6-27b9-4782-b7f1-2d8306aee103 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041907 Jun 02 13:41:59.431838 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 361/748] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:41:59 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:41:59.852233 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ec1c94ce-8b67-4289-8985-a814274cc071 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:41:59.852843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ec1c94ce-8b67-4289-8985-a814274cc071 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:41:59.859159 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec1c94ce-8b67-4289-8985-a814274cc071 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:59.859611 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec1c94ce-8b67-4289-8985-a814274cc071 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:59.860406 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec1c94ce-8b67-4289-8985-a814274cc071 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:41:59.860852 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec1c94ce-8b67-4289-8985-a814274cc071 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:41:59.941880 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-ec1c94ce-8b67-4289-8985-a814274cc071 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lazy-loading 'services' on Instance uuid 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:42:00.012458 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ec1c94ce-8b67-4289-8985-a814274cc071 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments/98deeac9-760c-487f-bfc3-08b411e07fbd" status: 202 len: 0 microversion: 2.1 time: 0.164241 Jun 02 13:42:00.013219 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 388/749] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:41:59 2022] DELETE /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments/98deeac9-760c-487f-bfc3-08b411e07fbd => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:42:00.021120 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0ba3116c-88f2-4ab7-bd75-1df6df1ab88c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:00.022040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0ba3116c-88f2-4ab7-bd75-1df6df1ab88c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:00.028173 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ba3116c-88f2-4ab7-bd75-1df6df1ab88c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.028656 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ba3116c-88f2-4ab7-bd75-1df6df1ab88c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.029419 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ba3116c-88f2-4ab7-bd75-1df6df1ab88c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.029855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ba3116c-88f2-4ab7-bd75-1df6df1ab88c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.058951 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0ba3116c-88f2-4ab7-bd75-1df6df1ab88c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041620 Jun 02 13:42:00.059503 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 362/750] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:42:00 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:00.309515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e251e528-e5b1-4584-9afa-7b56c9ec8c5a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:00.310558 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e251e528-e5b1-4584-9afa-7b56c9ec8c5a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:00.316790 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e251e528-e5b1-4584-9afa-7b56c9ec8c5a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.317247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e251e528-e5b1-4584-9afa-7b56c9ec8c5a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.318018 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e251e528-e5b1-4584-9afa-7b56c9ec8c5a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.318460 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e251e528-e5b1-4584-9afa-7b56c9ec8c5a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.348531 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e251e528-e5b1-4584-9afa-7b56c9ec8c5a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043697 Jun 02 13:42:00.348998 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 389/751] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:42:00 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:42:00.405116 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8eab4be8-4c44-4ed2-ba34-cfad52f0eed4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:00.405615 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8eab4be8-4c44-4ed2-ba34-cfad52f0eed4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:00.411989 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8eab4be8-4c44-4ed2-ba34-cfad52f0eed4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.412466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8eab4be8-4c44-4ed2-ba34-cfad52f0eed4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.413223 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8eab4be8-4c44-4ed2-ba34-cfad52f0eed4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.413678 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8eab4be8-4c44-4ed2-ba34-cfad52f0eed4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.437718 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8eab4be8-4c44-4ed2-ba34-cfad52f0eed4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:42:00.442885 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-04b18e74-2587-470f-8d9e-f2bdf5c3ba85 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:00.443816 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-04b18e74-2587-470f-8d9e-f2bdf5c3ba85 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:00.449782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-04b18e74-2587-470f-8d9e-f2bdf5c3ba85 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.450235 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-04b18e74-2587-470f-8d9e-f2bdf5c3ba85 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.451008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-04b18e74-2587-470f-8d9e-f2bdf5c3ba85 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.451454 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-04b18e74-2587-470f-8d9e-f2bdf5c3ba85 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.481182 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-04b18e74-2587-470f-8d9e-f2bdf5c3ba85 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042185 Jun 02 13:42:00.481745 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 390/752] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:42:00 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 13:42:00.492582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-40dd4a77-7184-495a-9bb7-fe0dd57e91f3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:00.493106 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-40dd4a77-7184-495a-9bb7-fe0dd57e91f3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:00.499492 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-40dd4a77-7184-495a-9bb7-fe0dd57e91f3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.499949 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-40dd4a77-7184-495a-9bb7-fe0dd57e91f3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.500827 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-40dd4a77-7184-495a-9bb7-fe0dd57e91f3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.501190 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-40dd4a77-7184-495a-9bb7-fe0dd57e91f3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.513006 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8eab4be8-4c44-4ed2-ba34-cfad52f0eed4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "DELETE /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 204 len: 0 microversion: 2.1 time: 0.111384 Jun 02 13:42:00.513591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 363/753] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:42:00 2022] DELETE /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:42:00.522559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f93ac37f-ac74-47b6-8ad3-6d2398c4c949 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:00.523263 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f93ac37f-ac74-47b6-8ad3-6d2398c4c949 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:00.529129 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f93ac37f-ac74-47b6-8ad3-6d2398c4c949 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.529609 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f93ac37f-ac74-47b6-8ad3-6d2398c4c949 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.530371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f93ac37f-ac74-47b6-8ad3-6d2398c4c949 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:00.530807 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f93ac37f-ac74-47b6-8ad3-6d2398c4c949 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:00.577032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-40dd4a77-7184-495a-9bb7-fe0dd57e91f3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] HTTP exception thrown: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b is not attached to volume bd472988-c457-4d6f-8c03-3a6065473483 Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-40dd4a77-7184-495a-9bb7-fe0dd57e91f3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Request method failure captured: Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments/bd472988-c457-4d6f-8c03-3a6065473483 HTTP/1.1 Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimL1EbTih5lzNa2IHLmosivMBcM6VTTPmeITKatkeqGh4DmuHQBXhzqDoLJ1gJzVkNbTcX3peQNrOsgmIn4ozQJGQ4DpLfeM0YH7IXcR7-Vt-yIS-XFxdkwHghNgIhRRGtsIY1nGXIsAWq2Rd1MkNjM9Q1IpwGxTd4hI4xSk6EgoY_30 Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 9f83cf655b9d41ebbaf0961d1d2581fc Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-TestMinimumBasicScenario-828239463 Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:42:00.586874 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/9f83cf655b9d41ebbaf0961d1d2581fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_9f83cf655b9d41ebbaf0961d1d2581fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/9f83cf655b9d41ebbaf0961d1d2581fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/9f83cf655b9d41ebbaf0961d1d2581fc"}]}] Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-TestMinimumBasicScenario-828239463 Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 9f83cf655b9d41ebbaf0961d1d2581fc Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-TestMinimumBasicScenario-828239463 Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-TestMinimumBasicScenario-828239463-project Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: a41010feed14482d869807c09f365a18 Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-TestMinimumBasicScenario-828239463-project Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:42:00.588676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b is not attached to volume bd472988-c457-4d6f-8c03-3a6065473483 Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'server_id': 'e2071a11-86aa-4a7f-962c-709f94eb7d6b', 'id': 'bd472988-c457-4d6f-8c03-3a6065473483'} Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bd472988-c457-4d6f-8c03-3a6065473483. Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:42:00.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b is not attached to volume bd472988-c457-4d6f-8c03-3a6065473483 Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b is not attached to volume bd472988-c457-4d6f-8c03-3a6065473483 Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:00.590917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-40dd4a77-7184-495a-9bb7-fe0dd57e91f3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Returning 404 to user: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b is not attached to volume bd472988-c457-4d6f-8c03-3a6065473483 {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:42:00.592055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-40dd4a77-7184-495a-9bb7-fe0dd57e91f3 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments/bd472988-c457-4d6f-8c03-3a6065473483" status: 404 len: 154 microversion: 2.1 time: 0.101464 Jun 02 13:42:00.592055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 391/754] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:42:00 2022] DELETE /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b/os-volume_attachments/bd472988-c457-4d6f-8c03-3a6065473483 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:42:00.669812 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f93ac37f-ac74-47b6-8ad3-6d2398c4c949 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:00.677527 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f93ac37f-ac74-47b6-8ad3-6d2398c4c949 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1674 microversion: 2.1 time: 0.159391 Jun 02 13:42:00.678090 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 364/755] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:00 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:01.072387 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1dd03a1c-3aef-4430-98b4-96f88e97d00e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:01.073325 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1dd03a1c-3aef-4430-98b4-96f88e97d00e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:01.079634 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1dd03a1c-3aef-4430-98b4-96f88e97d00e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:01.080116 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1dd03a1c-3aef-4430-98b4-96f88e97d00e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:01.080914 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1dd03a1c-3aef-4430-98b4-96f88e97d00e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:01.081356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1dd03a1c-3aef-4430-98b4-96f88e97d00e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:01.112759 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1dd03a1c-3aef-4430-98b4-96f88e97d00e tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045596 Jun 02 13:42:01.113191 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 392/756] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:42:01 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:01.629326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9a3861bd-0626-4175-9038-43c1ddccb666 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:01.629834 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9a3861bd-0626-4175-9038-43c1ddccb666 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:01.635774 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a3861bd-0626-4175-9038-43c1ddccb666 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:01.636231 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a3861bd-0626-4175-9038-43c1ddccb666 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:01.637058 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a3861bd-0626-4175-9038-43c1ddccb666 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:01.637505 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a3861bd-0626-4175-9038-43c1ddccb666 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:01.661782 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9a3861bd-0626-4175-9038-43c1ddccb666 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/ips" status: 200 len: 150 microversion: 2.1 time: 0.086657 Jun 02 13:42:01.662320 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 365/757] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Jun 2 13:42:01 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/ips => generated 150 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:01.694514 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4d2b3897-61a1-4c83-a392-b74c71b616c7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:01.695138 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4d2b3897-61a1-4c83-a392-b74c71b616c7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:01.701890 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d2b3897-61a1-4c83-a392-b74c71b616c7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:01.702354 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d2b3897-61a1-4c83-a392-b74c71b616c7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:01.703398 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d2b3897-61a1-4c83-a392-b74c71b616c7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:01.703843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d2b3897-61a1-4c83-a392-b74c71b616c7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:01.727262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-efda11ee-fd76-4712-87d4-c6c62baf1854 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:01.728101 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-efda11ee-fd76-4712-87d4-c6c62baf1854 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:01.734413 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-efda11ee-fd76-4712-87d4-c6c62baf1854 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:01.735102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-efda11ee-fd76-4712-87d4-c6c62baf1854 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:01.736081 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-efda11ee-fd76-4712-87d4-c6c62baf1854 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:01.736714 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-efda11ee-fd76-4712-87d4-c6c62baf1854 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:01.761648 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-efda11ee-fd76-4712-87d4-c6c62baf1854 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:42:01.838968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-efda11ee-fd76-4712-87d4-c6c62baf1854 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 204 len: 0 microversion: 2.1 time: 0.115731 Jun 02 13:42:01.839862 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 366/758] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:42:01 2022] DELETE /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 02 13:42:01.842198 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4d2b3897-61a1-4c83-a392-b74c71b616c7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:01.848909 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cfb2a1c3-2edf-424f-853a-dc1e14ed24f5 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:01.849671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cfb2a1c3-2edf-424f-853a-dc1e14ed24f5 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:01.850204 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4d2b3897-61a1-4c83-a392-b74c71b616c7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1674 microversion: 2.1 time: 0.159436 Jun 02 13:42:01.859854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cfb2a1c3-2edf-424f-853a-dc1e14ed24f5 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:01.859854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cfb2a1c3-2edf-424f-853a-dc1e14ed24f5 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:01.859854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cfb2a1c3-2edf-424f-853a-dc1e14ed24f5 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:01.859854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cfb2a1c3-2edf-424f-853a-dc1e14ed24f5 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:01.860625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 393/759] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:01 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:02.009263 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cfb2a1c3-2edf-424f-853a-dc1e14ed24f5 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:02.017717 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cfb2a1c3-2edf-424f-853a-dc1e14ed24f5 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1554 microversion: 2.1 time: 0.173752 Jun 02 13:42:02.018279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 367/760] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:01 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:02.123404 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-531d81f8-a08f-424a-b8a7-28c69a36a6b1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:02.124328 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-531d81f8-a08f-424a-b8a7-28c69a36a6b1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:02.130416 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-531d81f8-a08f-424a-b8a7-28c69a36a6b1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:02.130937 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-531d81f8-a08f-424a-b8a7-28c69a36a6b1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:02.131707 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-531d81f8-a08f-424a-b8a7-28c69a36a6b1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:02.132152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-531d81f8-a08f-424a-b8a7-28c69a36a6b1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:02.160367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-531d81f8-a08f-424a-b8a7-28c69a36a6b1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041209 Jun 02 13:42:02.161582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 394/761] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:42:02 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:02.867207 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f0305d92-b885-4778-8f74-4fa1d9c7325d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:02.867754 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f0305d92-b885-4778-8f74-4fa1d9c7325d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:02.874223 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0305d92-b885-4778-8f74-4fa1d9c7325d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:02.874684 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0305d92-b885-4778-8f74-4fa1d9c7325d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:02.875456 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0305d92-b885-4778-8f74-4fa1d9c7325d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:02.875900 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0305d92-b885-4778-8f74-4fa1d9c7325d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:03.007336 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f0305d92-b885-4778-8f74-4fa1d9c7325d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:03.013607 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-88e97e5c-5dcc-401a-9249-3a601a977173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aed13005-5c5b-4f3e-a6f0-d30efaa475b7"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:03.015314 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-88e97e5c-5dcc-401a-9249-3a601a977173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:03.018174 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f0305d92-b885-4778-8f74-4fa1d9c7325d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1674 microversion: 2.1 time: 0.155310 Jun 02 13:42:03.019231 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 368/762] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:02 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:03.023742 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88e97e5c-5dcc-401a-9249-3a601a977173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:03.023742 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88e97e5c-5dcc-401a-9249-3a601a977173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:03.024527 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88e97e5c-5dcc-401a-9249-3a601a977173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:03.024968 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88e97e5c-5dcc-401a-9249-3a601a977173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:03.034798 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d2346b02-1fdb-4e48-8109-9c70a8c84d5b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:03.035503 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d2346b02-1fdb-4e48-8109-9c70a8c84d5b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:03.041601 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d2346b02-1fdb-4e48-8109-9c70a8c84d5b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:03.042059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d2346b02-1fdb-4e48-8109-9c70a8c84d5b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:03.042826 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d2346b02-1fdb-4e48-8109-9c70a8c84d5b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:03.043258 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d2346b02-1fdb-4e48-8109-9c70a8c84d5b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:03.175660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d2346b02-1fdb-4e48-8109-9c70a8c84d5b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:03.183813 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d2346b02-1fdb-4e48-8109-9c70a8c84d5b tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1554 microversion: 2.1 time: 0.152847 Jun 02 13:42:03.184392 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 369/763] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:03 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:03.188956 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-841febdc-7b34-403d-a784-8b1c6fddab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:03.189966 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-841febdc-7b34-403d-a784-8b1c6fddab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:03.195695 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-841febdc-7b34-403d-a784-8b1c6fddab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:03.196150 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-841febdc-7b34-403d-a784-8b1c6fddab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:03.196969 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-841febdc-7b34-403d-a784-8b1c6fddab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:03.197421 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-841febdc-7b34-403d-a784-8b1c6fddab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:03.226332 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-841febdc-7b34-403d-a784-8b1c6fddab3a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040974 Jun 02 13:42:03.226874 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 370/764] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:42:03 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:04.034926 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1be4f76c-1eed-450e-87fb-1254d917a0cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:04.035642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1be4f76c-1eed-450e-87fb-1254d917a0cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:04.042068 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1be4f76c-1eed-450e-87fb-1254d917a0cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:04.042521 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1be4f76c-1eed-450e-87fb-1254d917a0cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:04.043321 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1be4f76c-1eed-450e-87fb-1254d917a0cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:04.043763 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1be4f76c-1eed-450e-87fb-1254d917a0cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:04.169405 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1be4f76c-1eed-450e-87fb-1254d917a0cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:04.177476 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1be4f76c-1eed-450e-87fb-1254d917a0cb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1674 microversion: 2.1 time: 0.146429 Jun 02 13:42:04.178036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 371/765] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:04 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:04.200248 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0f8e0158-5696-462d-a8ba-273f3d365317 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:04.200892 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0f8e0158-5696-462d-a8ba-273f3d365317 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:04.206862 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f8e0158-5696-462d-a8ba-273f3d365317 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:04.207318 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f8e0158-5696-462d-a8ba-273f3d365317 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:04.208086 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f8e0158-5696-462d-a8ba-273f3d365317 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:04.208579 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f8e0158-5696-462d-a8ba-273f3d365317 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:04.338710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0f8e0158-5696-462d-a8ba-273f3d365317 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:04.346419 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0f8e0158-5696-462d-a8ba-273f3d365317 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1554 microversion: 2.1 time: 0.149633 Jun 02 13:42:04.347010 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 372/766] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:04 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:04.351542 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1c097493-bc02-49cc-bcee-67d5ed24daeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:04.352483 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1c097493-bc02-49cc-bcee-67d5ed24daeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:04.358054 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c097493-bc02-49cc-bcee-67d5ed24daeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:04.358503 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c097493-bc02-49cc-bcee-67d5ed24daeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:04.359263 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c097493-bc02-49cc-bcee-67d5ed24daeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:04.359699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c097493-bc02-49cc-bcee-67d5ed24daeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:04.363359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:04.390740 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1c097493-bc02-49cc-bcee-67d5ed24daeb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042736 Jun 02 13:42:04.391286 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 373/767] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:42:04 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:04.902108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-88e97e5c-5dcc-401a-9249-3a601a977173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.895813 Jun 02 13:42:04.902845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 395/768] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:42:03 2022] POST /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments => generated 194 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:05.194655 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-21d783d3-a93f-42d2-9836-4d8cf1a12476 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:05.196826 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-21d783d3-a93f-42d2-9836-4d8cf1a12476 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:05.203587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-21d783d3-a93f-42d2-9836-4d8cf1a12476 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.204040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-21d783d3-a93f-42d2-9836-4d8cf1a12476 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.204855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-21d783d3-a93f-42d2-9836-4d8cf1a12476 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.205303 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-21d783d3-a93f-42d2-9836-4d8cf1a12476 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.352832 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-21d783d3-a93f-42d2-9836-4d8cf1a12476 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:05.361271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-21d783d3-a93f-42d2-9836-4d8cf1a12476 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1674 microversion: 2.1 time: 0.170495 Jun 02 13:42:05.362414 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 374/769] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:05 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:05.364095 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-06290a23-6f06-40e0-b71a-f03ef01e1d3c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:05.365225 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-06290a23-6f06-40e0-b71a-f03ef01e1d3c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:05.371851 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-06290a23-6f06-40e0-b71a-f03ef01e1d3c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.372332 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-06290a23-6f06-40e0-b71a-f03ef01e1d3c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.373121 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-06290a23-6f06-40e0-b71a-f03ef01e1d3c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.373568 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-06290a23-6f06-40e0-b71a-f03ef01e1d3c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.402344 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ab9be100-f0a4-4f83-8350-7c07d05c2a04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:05.403508 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ab9be100-f0a4-4f83-8350-7c07d05c2a04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:05.410103 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab9be100-f0a4-4f83-8350-7c07d05c2a04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.410680 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab9be100-f0a4-4f83-8350-7c07d05c2a04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.411559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab9be100-f0a4-4f83-8350-7c07d05c2a04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.412128 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab9be100-f0a4-4f83-8350-7c07d05c2a04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.450799 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ab9be100-f0a4-4f83-8350-7c07d05c2a04 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052263 Jun 02 13:42:05.456560 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 375/770] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:42:05 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 13:42:05.522275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-06290a23-6f06-40e0-b71a-f03ef01e1d3c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:05.532078 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-06290a23-6f06-40e0-b71a-f03ef01e1d3c tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1554 microversion: 2.1 time: 0.172584 Jun 02 13:42:05.533852 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0324d7f0-a947-42fd-8768-38bd143e5bb5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:05.534485 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0324d7f0-a947-42fd-8768-38bd143e5bb5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:05.542345 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 396/771] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:05 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:05.547682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0324d7f0-a947-42fd-8768-38bd143e5bb5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.548257 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0324d7f0-a947-42fd-8768-38bd143e5bb5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.549175 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0324d7f0-a947-42fd-8768-38bd143e5bb5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.549691 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0324d7f0-a947-42fd-8768-38bd143e5bb5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.575080 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0324d7f0-a947-42fd-8768-38bd143e5bb5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:42:05.686839 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0324d7f0-a947-42fd-8768-38bd143e5bb5 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 204 len: 0 microversion: 2.1 time: 0.157250 Jun 02 13:42:05.687673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 376/772] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:42:05 2022] DELETE /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:42:05.697026 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0c54f7f3-dfd7-4537-86f5-5e58c29ff163 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:05.698039 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0c54f7f3-dfd7-4537-86f5-5e58c29ff163 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:05.705622 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0c54f7f3-dfd7-4537-86f5-5e58c29ff163 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.706204 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0c54f7f3-dfd7-4537-86f5-5e58c29ff163 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.707149 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0c54f7f3-dfd7-4537-86f5-5e58c29ff163 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.707637 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0c54f7f3-dfd7-4537-86f5-5e58c29ff163 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.746287 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-5dac6762-1f94-4291-ba8c-c535fdac236c req-fe3542b8-7f3f-4c3d-bc48-46ad94f02fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2071a11-86aa-4a7f-962c-709f94eb7d6b", "name": "network-vif-deleted", "tag": "46bae571-c4cf-494a-ae5d-a0def33d7330"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:05.756403 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-5dac6762-1f94-4291-ba8c-c535fdac236c req-fe3542b8-7f3f-4c3d-bc48-46ad94f02fc4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:05.756554 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-5dac6762-1f94-4291-ba8c-c535fdac236c req-fe3542b8-7f3f-4c3d-bc48-46ad94f02fc4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:05.770638 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-5dac6762-1f94-4291-ba8c-c535fdac236c req-fe3542b8-7f3f-4c3d-bc48-46ad94f02fc4 service nova] Creating event network-vif-deleted:46bae571-c4cf-494a-ae5d-a0def33d7330 for instance e2071a11-86aa-4a7f-962c-709f94eb7d6b on hv-cinder-83608 Jun 02 13:42:05.782935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-5dac6762-1f94-4291-ba8c-c535fdac236c req-fe3542b8-7f3f-4c3d-bc48-46ad94f02fc4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120098 Jun 02 13:42:05.783564 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 397/773] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:05.874481 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0c54f7f3-dfd7-4537-86f5-5e58c29ff163 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:05.882827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0c54f7f3-dfd7-4537-86f5-5e58c29ff163 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1690 microversion: 2.1 time: 0.190943 Jun 02 13:42:05.883487 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 377/774] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:05 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:06.379959 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-65d9d225-438b-4dcb-912f-95da4bb9e5d6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:06.380707 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-65d9d225-438b-4dcb-912f-95da4bb9e5d6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:06.387051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-65d9d225-438b-4dcb-912f-95da4bb9e5d6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:06.387498 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-65d9d225-438b-4dcb-912f-95da4bb9e5d6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:06.388317 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-65d9d225-438b-4dcb-912f-95da4bb9e5d6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:06.388760 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-65d9d225-438b-4dcb-912f-95da4bb9e5d6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:06.451827 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-65d9d225-438b-4dcb-912f-95da4bb9e5d6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:06.460356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-65d9d225-438b-4dcb-912f-95da4bb9e5d6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1606 microversion: 2.1 time: 0.084991 Jun 02 13:42:06.461086 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 398/775] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:06 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1606 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:06.549959 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0763109f-d4a5-4aff-bcc0-8f880b0fe6d4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:06.550665 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0763109f-d4a5-4aff-bcc0-8f880b0fe6d4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:06.557563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0763109f-d4a5-4aff-bcc0-8f880b0fe6d4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:06.558097 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0763109f-d4a5-4aff-bcc0-8f880b0fe6d4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:06.558871 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0763109f-d4a5-4aff-bcc0-8f880b0fe6d4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:06.559310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0763109f-d4a5-4aff-bcc0-8f880b0fe6d4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:06.620155 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0763109f-d4a5-4aff-bcc0-8f880b0fe6d4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:06.629036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0763109f-d4a5-4aff-bcc0-8f880b0fe6d4 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1344 microversion: 2.1 time: 0.082793 Jun 02 13:42:06.629798 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 378/776] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:06 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:06.898984 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ad884e46-fbc1-4b10-8ce8-8222e4ae472c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:06.899739 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ad884e46-fbc1-4b10-8ce8-8222e4ae472c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:06.905903 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad884e46-fbc1-4b10-8ce8-8222e4ae472c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:06.906356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad884e46-fbc1-4b10-8ce8-8222e4ae472c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:06.907129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad884e46-fbc1-4b10-8ce8-8222e4ae472c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:06.907567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad884e46-fbc1-4b10-8ce8-8222e4ae472c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:07.045933 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ad884e46-fbc1-4b10-8ce8-8222e4ae472c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:07.054308 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ad884e46-fbc1-4b10-8ce8-8222e4ae472c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1690 microversion: 2.1 time: 0.159194 Jun 02 13:42:07.062349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 399/777] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:06 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:07.477626 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4556e20c-d62c-40e1-b18d-1f6c7f972d3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:07.478235 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4556e20c-d62c-40e1-b18d-1f6c7f972d3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:07.484404 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4556e20c-d62c-40e1-b18d-1f6c7f972d3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:07.484854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4556e20c-d62c-40e1-b18d-1f6c7f972d3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:07.485636 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4556e20c-d62c-40e1-b18d-1f6c7f972d3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:07.486073 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4556e20c-d62c-40e1-b18d-1f6c7f972d3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:07.547804 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4556e20c-d62c-40e1-b18d-1f6c7f972d3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:07.555133 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4556e20c-d62c-40e1-b18d-1f6c7f972d3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1606 microversion: 2.1 time: 0.081969 Jun 02 13:42:07.555692 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 379/778] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:07 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1606 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:07.646429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2a854617-d35a-4724-b51b-d0f7d06c1e40 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:07.647042 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2a854617-d35a-4724-b51b-d0f7d06c1e40 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:07.653399 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a854617-d35a-4724-b51b-d0f7d06c1e40 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:07.653843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a854617-d35a-4724-b51b-d0f7d06c1e40 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:07.654600 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a854617-d35a-4724-b51b-d0f7d06c1e40 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:07.655034 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a854617-d35a-4724-b51b-d0f7d06c1e40 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:07.673455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:07.717108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2a854617-d35a-4724-b51b-d0f7d06c1e40 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:07.724529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2a854617-d35a-4724-b51b-d0f7d06c1e40 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1344 microversion: 2.1 time: 0.082493 Jun 02 13:42:07.725092 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 400/779] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:07 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:07.801236 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-2c94ab41-90bf-4567-b2d6-3f7a7e0fe6c0 req-763003c8-30f0-4e38-89f4-86d79e042e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ef14f4-ad83-4f47-bcf7-cd051e84dcef", "name": "network-vif-deleted", "tag": "eae534a3-0e2b-44d2-90c9-88a5548068b2"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:07.809690 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-2c94ab41-90bf-4567-b2d6-3f7a7e0fe6c0 req-763003c8-30f0-4e38-89f4-86d79e042e8d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:07.810135 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-2c94ab41-90bf-4567-b2d6-3f7a7e0fe6c0 req-763003c8-30f0-4e38-89f4-86d79e042e8d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:07.821365 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-2c94ab41-90bf-4567-b2d6-3f7a7e0fe6c0 req-763003c8-30f0-4e38-89f4-86d79e042e8d service nova] Creating event network-vif-deleted:eae534a3-0e2b-44d2-90c9-88a5548068b2 for instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef on hv-cinder-83608 Jun 02 13:42:07.826107 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-2c94ab41-90bf-4567-b2d6-3f7a7e0fe6c0 req-763003c8-30f0-4e38-89f4-86d79e042e8d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028580 Jun 02 13:42:07.826660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 380/780] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:08.071594 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f842e946-a62e-49b0-8d49-9b9a8f11039c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:08.072202 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f842e946-a62e-49b0-8d49-9b9a8f11039c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:08.078510 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f842e946-a62e-49b0-8d49-9b9a8f11039c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:08.078953 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f842e946-a62e-49b0-8d49-9b9a8f11039c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:08.079707 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f842e946-a62e-49b0-8d49-9b9a8f11039c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:08.080142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f842e946-a62e-49b0-8d49-9b9a8f11039c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:08.208104 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f842e946-a62e-49b0-8d49-9b9a8f11039c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:08.215601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f842e946-a62e-49b0-8d49-9b9a8f11039c tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1690 microversion: 2.1 time: 0.148455 Jun 02 13:42:08.216162 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 401/781] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:08 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:08.572526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d270945f-d0a7-4c86-addf-ae1b7268ed15 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:08.573421 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d270945f-d0a7-4c86-addf-ae1b7268ed15 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:08.580272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d270945f-d0a7-4c86-addf-ae1b7268ed15 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:08.580757 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d270945f-d0a7-4c86-addf-ae1b7268ed15 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:08.581548 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d270945f-d0a7-4c86-addf-ae1b7268ed15 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:08.581993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d270945f-d0a7-4c86-addf-ae1b7268ed15 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:08.647578 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d270945f-d0a7-4c86-addf-ae1b7268ed15 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:08.655590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d270945f-d0a7-4c86-addf-ae1b7268ed15 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1606 microversion: 2.1 time: 0.087084 Jun 02 13:42:08.656159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 381/782] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:08 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1606 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:08.741623 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-99805687-9d05-4654-b345-dc824d4495e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:08.742268 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-99805687-9d05-4654-b345-dc824d4495e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:08.748718 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-99805687-9d05-4654-b345-dc824d4495e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:08.749171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-99805687-9d05-4654-b345-dc824d4495e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:08.749934 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-99805687-9d05-4654-b345-dc824d4495e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:08.750372 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-99805687-9d05-4654-b345-dc824d4495e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:08.810253 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-99805687-9d05-4654-b345-dc824d4495e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:08.818400 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-99805687-9d05-4654-b345-dc824d4495e7 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1344 microversion: 2.1 time: 0.081159 Jun 02 13:42:08.818964 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 402/783] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:08 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1344 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:09.232174 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c5a54645-ae42-4d4a-9af4-ab425f6c5deb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:09.232821 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c5a54645-ae42-4d4a-9af4-ab425f6c5deb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:09.239925 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c5a54645-ae42-4d4a-9af4-ab425f6c5deb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:09.240412 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c5a54645-ae42-4d4a-9af4-ab425f6c5deb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:09.241186 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c5a54645-ae42-4d4a-9af4-ab425f6c5deb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:09.241635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c5a54645-ae42-4d4a-9af4-ab425f6c5deb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:09.367583 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c5a54645-ae42-4d4a-9af4-ab425f6c5deb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:09.375635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c5a54645-ae42-4d4a-9af4-ab425f6c5deb tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1690 microversion: 2.1 time: 0.147203 Jun 02 13:42:09.376506 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 382/784] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:09 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:09.673005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b56a55d7-717d-4d86-8cf7-282239b28a5e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:09.673614 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b56a55d7-717d-4d86-8cf7-282239b28a5e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:09.679529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b56a55d7-717d-4d86-8cf7-282239b28a5e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:09.679980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b56a55d7-717d-4d86-8cf7-282239b28a5e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:09.680788 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b56a55d7-717d-4d86-8cf7-282239b28a5e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:09.681231 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b56a55d7-717d-4d86-8cf7-282239b28a5e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:09.744547 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b56a55d7-717d-4d86-8cf7-282239b28a5e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:09.752505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b56a55d7-717d-4d86-8cf7-282239b28a5e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1322 microversion: 2.1 time: 0.083291 Jun 02 13:42:09.753070 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 403/785] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:09 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1322 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:09.835301 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:09.835914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:09.841989 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:09.842447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:09.843216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:09.843655 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:09.872585 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:09.873043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:09.873501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lazy-loading 'fault' on Instance uuid e2071a11-86aa-4a7f-962c-709f94eb7d6b {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:42:09.913736 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41010feed14482d869807c09f365a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f83cf655b9d41ebbaf0961d1d2581fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:09.921163 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b46620e2-85c5-45f2-b83d-1cd6905a4b99 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 200 len: 1349 microversion: 2.1 time: 0.090368 Jun 02 13:42:09.921726 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 383/786] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:09 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:10.391664 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b07bb891-a1a1-4dc3-9ff5-941b8f905000 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:10.392283 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b07bb891-a1a1-4dc3-9ff5-941b8f905000 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:10.398399 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b07bb891-a1a1-4dc3-9ff5-941b8f905000 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:10.398857 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b07bb891-a1a1-4dc3-9ff5-941b8f905000 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:10.399629 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b07bb891-a1a1-4dc3-9ff5-941b8f905000 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:10.400077 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b07bb891-a1a1-4dc3-9ff5-941b8f905000 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:10.524994 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b07bb891-a1a1-4dc3-9ff5-941b8f905000 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:10.532489 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b07bb891-a1a1-4dc3-9ff5-941b8f905000 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1690 microversion: 2.1 time: 0.144713 Jun 02 13:42:10.533058 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 404/787] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:10 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1690 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:10.770695 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:10.771257 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:10.777854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:10.778311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:10.779084 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:10.779526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:10.810841 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:10.811297 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:10.811756 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lazy-loading 'fault' on Instance uuid 50ef14f4-ad83-4f47-bcf7-cd051e84dcef {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:42:10.857539 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:10.866334 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-02a5f875-753f-4ece-bbb4-f1cd1375282d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 200 len: 1327 microversion: 2.1 time: 0.100951 Jun 02 13:42:10.867283 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 384/788] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:10 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:10.938185 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4023c35c-05c7-4c90-9c11-ca47b6fe12c2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:10.938797 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4023c35c-05c7-4c90-9c11-ca47b6fe12c2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] [instance: e2071a11-86aa-4a7f-962c-709f94eb7d6b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:10.945305 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4023c35c-05c7-4c90-9c11-ca47b6fe12c2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:10.945753 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4023c35c-05c7-4c90-9c11-ca47b6fe12c2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:10.946515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4023c35c-05c7-4c90-9c11-ca47b6fe12c2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:10.946950 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4023c35c-05c7-4c90-9c11-ca47b6fe12c2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:10.961838 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-4023c35c-05c7-4c90-9c11-ca47b6fe12c2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] HTTP exception thrown: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b could not be found. Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4023c35c-05c7-4c90-9c11-ca47b6fe12c2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Request method failure captured: Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b HTTP/1.1 Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimL1EbTih5lzNa2IHLmosivMBcM6VTTPmeITKatkeqGh4DmuHQBXhzqDoLJ1gJzVkNbTcX3peQNrOsgmIn4ozQJGQ4DpLfeM0YH7IXcR7-Vt-yIS-XFxdkwHghNgIhRRGtsIY1nGXIsAWq2Rd1MkNjM9Q1IpwGxTd4hI4xSk6EgoY_30 Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 9f83cf655b9d41ebbaf0961d1d2581fc Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-TestMinimumBasicScenario-828239463 Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:42:10.963529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/9f83cf655b9d41ebbaf0961d1d2581fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_9f83cf655b9d41ebbaf0961d1d2581fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/9f83cf655b9d41ebbaf0961d1d2581fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/9f83cf655b9d41ebbaf0961d1d2581fc"}]}] Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-TestMinimumBasicScenario-828239463 Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 9f83cf655b9d41ebbaf0961d1d2581fc Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-TestMinimumBasicScenario-828239463 Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-TestMinimumBasicScenario-828239463-project Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: a41010feed14482d869807c09f365a18 Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-TestMinimumBasicScenario-828239463-project Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b could not be found. Jun 02 13:42:10.965096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'e2071a11-86aa-4a7f-962c-709f94eb7d6b'} Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b could not be found. Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:42:10.965875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b could not be found. Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b could not be found. Jun 02 13:42:10.967073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:10.968168 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4023c35c-05c7-4c90-9c11-ca47b6fe12c2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Returning 404 to user: Instance e2071a11-86aa-4a7f-962c-709f94eb7d6b could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:42:10.968168 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4023c35c-05c7-4c90-9c11-ca47b6fe12c2 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b" status: 404 len: 111 microversion: 2.1 time: 0.030725 Jun 02 13:42:10.968168 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 405/789] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:10 2022] GET /compute/v2.1/servers/e2071a11-86aa-4a7f-962c-709f94eb7d6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:42:10.974754 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-89d682db-7e3e-45cb-bac4-1840befb6c22 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] Calling method '.version_select at 0x7f861502f670>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:10.993656 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-89d682db-7e3e-45cb-bac4-1840befb6c22 tempest-TestMinimumBasicScenario-828239463 tempest-TestMinimumBasicScenario-828239463-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1904709435" status: 202 len: 0 microversion: 2.1 time: 0.023245 Jun 02 13:42:10.994458 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 385/790] 10.222.0.32 () {58 vars in 1271 bytes} [Thu Jun 2 13:42:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1904709435 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:42:11.548070 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6fc31e13-181f-43b1-a2ab-b17306e9e17a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:11.548814 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6fc31e13-181f-43b1-a2ab-b17306e9e17a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:11.555650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6fc31e13-181f-43b1-a2ab-b17306e9e17a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:11.556191 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6fc31e13-181f-43b1-a2ab-b17306e9e17a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:11.557072 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6fc31e13-181f-43b1-a2ab-b17306e9e17a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:11.557769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6fc31e13-181f-43b1-a2ab-b17306e9e17a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:11.636410 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6fc31e13-181f-43b1-a2ab-b17306e9e17a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:11.654888 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6fc31e13-181f-43b1-a2ab-b17306e9e17a tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 200 len: 1622 microversion: 2.1 time: 0.102915 Jun 02 13:42:11.655278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 406/791] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:11 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 1622 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:11.889518 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c99ae229-2c6e-47b3-956c-84710d00bde4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:11.891194 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c99ae229-2c6e-47b3-956c-84710d00bde4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:11.898456 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-f1e2458b-c354-4483-883d-7e8259100a0f req-7a652248-f84a-41d5-9617-5ce96341e8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8851d9-9e33-4d8f-b120-f3b71a4f44a0", "name": "network-vif-deleted", "tag": "331888dc-5e0f-4a52-be55-4b6a38503c9d"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:11.911238 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-f1e2458b-c354-4483-883d-7e8259100a0f req-7a652248-f84a-41d5-9617-5ce96341e8fb service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:11.912749 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-f1e2458b-c354-4483-883d-7e8259100a0f req-7a652248-f84a-41d5-9617-5ce96341e8fb service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:11.924856 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c99ae229-2c6e-47b3-956c-84710d00bde4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:11.925573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c99ae229-2c6e-47b3-956c-84710d00bde4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:11.926568 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c99ae229-2c6e-47b3-956c-84710d00bde4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:11.927423 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c99ae229-2c6e-47b3-956c-84710d00bde4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:11.929362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-f1e2458b-c354-4483-883d-7e8259100a0f req-7a652248-f84a-41d5-9617-5ce96341e8fb service nova] Creating event network-vif-deleted:331888dc-5e0f-4a52-be55-4b6a38503c9d for instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 on hv-cinder-83608 Jun 02 13:42:11.935945 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-f1e2458b-c354-4483-883d-7e8259100a0f req-7a652248-f84a-41d5-9617-5ce96341e8fb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041673 Jun 02 13:42:11.937623 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 407/792] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:42:11.954452 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-c99ae229-2c6e-47b3-956c-84710d00bde4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] HTTP exception thrown: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c99ae229-2c6e-47b3-956c-84710d00bde4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Request method failure captured: Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef HTTP/1.1 Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzbigMGsV69hp-9UjsF2kBzz18OMivkkIlocYD4sWJYe58ggsVEjRBn1ecTO5KNSsRz3XbHDQIcs5LfBS1Rz4pR07rIuYImr1CYCqmFJNgP4tSXx9OlAHJEwyZLgZqZ6gBzF9s_qkQ2T8L1xzLG31hoE5TTSHCiCbhJw0eCIlBGOGw Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:42:11.957590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}] Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 4e88422338024035b5c64d2788965086 Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:42:11.959139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '50ef14f4-ad83-4f47-bcf7-cd051e84dcef'} Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:42:11.960043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:42:11.961492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:11.964425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c99ae229-2c6e-47b3-956c-84710d00bde4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Returning 404 to user: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:42:11.965552 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c99ae229-2c6e-47b3-956c-84710d00bde4 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 404 len: 111 microversion: 2.1 time: 0.086239 Jun 02 13:42:11.966977 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 386/793] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:11 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:42:11.987472 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4b48b0d9-38f7-4a83-a4ee-2b62a6f073a6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '.version_select at 0x7f861509fc10>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:12.013335 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4b48b0d9-38f7-4a83-a4ee-2b62a6f073a6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-322418662" status: 202 len: 0 microversion: 2.1 time: 0.041523 Jun 02 13:42:12.018491 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 408/794] 10.222.0.32 () {58 vars in 1217 bytes} [Thu Jun 2 13:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-322418662 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:42:12.494166 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bda98e82-bfcd-40f1-890b-494c8b4d393c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aed13005-5c5b-4f3e-a6f0-d30efaa475b7"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:12.495518 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bda98e82-bfcd-40f1-890b-494c8b4d393c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:12.502527 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda98e82-bfcd-40f1-890b-494c8b4d393c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:12.503174 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda98e82-bfcd-40f1-890b-494c8b4d393c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:12.504635 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda98e82-bfcd-40f1-890b-494c8b4d393c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:12.505429 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda98e82-bfcd-40f1-890b-494c8b4d393c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:12.599430 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-bda98e82-bfcd-40f1-890b-494c8b4d393c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Invalid volume: volume aed13005-5c5b-4f3e-a6f0-d30efaa475b7 is already attached to instances: d660d9e5-4816-47f4-b60a-922f53b35cd2 Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bda98e82-bfcd-40f1-890b-494c8b4d393c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: POST /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments HTTP/1.1 Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 74 Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:42:12.601372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {"volumeAttachment": {"volumeId": "aed13005-5c5b-4f3e-a6f0-d30efaa475b7"}} Jun 02 13:42:12.602922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Invalid volume: volume aed13005-5c5b-4f3e-a6f0-d30efaa475b7 is already attached to instances: d660d9e5-4816-47f4-b60a-922f53b35cd2 Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'server_id': 'd660d9e5-4816-47f4-b60a-922f53b35cd2', 'body': {'volumeAttachment': {'volumeId': 'aed13005-5c5b-4f3e-a6f0-d30efaa475b7'}}} Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aed13005-5c5b-4f3e-a6f0-d30efaa475b7 is already attached to instances: d660d9e5-4816-47f4-b60a-922f53b35cd2 Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:12.603844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aed13005-5c5b-4f3e-a6f0-d30efaa475b7 is already attached to instances: d660d9e5-4816-47f4-b60a-922f53b35cd2 Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:12.605243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:12.606642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:12.606642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:42:12.606642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:42:12.606642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aed13005-5c5b-4f3e-a6f0-d30efaa475b7 is already attached to instances: d660d9e5-4816-47f4-b60a-922f53b35cd2 Jun 02 13:42:12.606642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:12.607996 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bda98e82-bfcd-40f1-890b-494c8b4d393c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 400 to user: Invalid volume: volume aed13005-5c5b-4f3e-a6f0-d30efaa475b7 is already attached to instances: d660d9e5-4816-47f4-b60a-922f53b35cd2 {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:42:12.609087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bda98e82-bfcd-40f1-890b-494c8b4d393c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119313 Jun 02 13:42:12.609848 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 387/795] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:42:12 2022] POST /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:42:12.678153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7b2a35d6-a8db-4ff6-af0d-8e2c5bf20004 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:12.680010 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7b2a35d6-a8db-4ff6-af0d-8e2c5bf20004 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:12.685983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f67f2214-53f0-4aa8-b83a-d3c8b3b9133a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:12.686802 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f67f2214-53f0-4aa8-b83a-d3c8b3b9133a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:12.689725 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7b2a35d6-a8db-4ff6-af0d-8e2c5bf20004 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:12.690282 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7b2a35d6-a8db-4ff6-af0d-8e2c5bf20004 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:12.692290 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7b2a35d6-a8db-4ff6-af0d-8e2c5bf20004 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:12.692849 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7b2a35d6-a8db-4ff6-af0d-8e2c5bf20004 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:12.694763 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f67f2214-53f0-4aa8-b83a-d3c8b3b9133a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:12.695471 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f67f2214-53f0-4aa8-b83a-d3c8b3b9133a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:12.696513 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f67f2214-53f0-4aa8-b83a-d3c8b3b9133a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:12.697339 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f67f2214-53f0-4aa8-b83a-d3c8b3b9133a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:12.711373 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-7b2a35d6-a8db-4ff6-af0d-8e2c5bf20004 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] HTTP exception thrown: Instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 could not be found. Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7b2a35d6-a8db-4ff6-af0d-8e2c5bf20004 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Request method failure captured: Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 HTTP/1.1 Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzSOc8zAN0uDeWOclgH-FIpci9Nk5ZltTZPNxM6Pkn07DHpAN-kLw8-tMMyEZ8olBGqS-_Vv3DH24STayy7hBz2mdCS88fQh0x5WYzrT0SJLDNGvis67219B7mMEZOwSIQ5eMGU1j2HAUo9dRY8qVWWRNCbB-LBVVcpQX5WGbiIlnM Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: ff89a4ee01d444d2aee3bdc9199d556f Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:42:12.713339 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ff89a4ee01d444d2aee3bdc9199d556f"}]}] Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: ff89a4ee01d444d2aee3bdc9199d556f Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-ServerRescueNegativeTestJSON-632983293-project Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: b92da35ea7c946ea876b13b13ed98258 Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-ServerRescueNegativeTestJSON-632983293-project Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 could not be found. Jun 02 13:42:12.714721 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '2d8851d9-9e33-4d8f-b120-f3b71a4f44a0'} Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 could not be found. Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:42:12.715473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 could not be found. Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 could not be found. Jun 02 13:42:12.716702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:12.717738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7b2a35d6-a8db-4ff6-af0d-8e2c5bf20004 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Returning 404 to user: Instance 2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:42:12.717738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7b2a35d6-a8db-4ff6-af0d-8e2c5bf20004 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0" status: 404 len: 111 microversion: 2.1 time: 0.053558 Jun 02 13:42:12.717738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 409/796] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:12 2022] GET /compute/v2.1/servers/2d8851d9-9e33-4d8f-b120-f3b71a4f44a0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:42:12.724523 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-40215f66-8793-4b40-a3b7-4bbac006d6ff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '.version_select at 0x7f8614e3b3a0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:12.746418 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-40215f66-8793-4b40-a3b7-4bbac006d6ff tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392736319" status: 202 len: 0 microversion: 2.1 time: 0.026283 Jun 02 13:42:12.747315 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 410/797] 10.222.0.32 () {58 vars in 1220 bytes} [Thu Jun 2 13:42:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392736319 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:42:12.825902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-f67f2214-53f0-4aa8-b83a-d3c8b3b9133a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lazy-loading 'services' on Instance uuid d660d9e5-4816-47f4-b60a-922f53b35cd2 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:42:12.934947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f67f2214-53f0-4aa8-b83a-d3c8b3b9133a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments/aed13005-5c5b-4f3e-a6f0-d30efaa475b7" status: 202 len: 0 microversion: 2.1 time: 0.251667 Jun 02 13:42:12.940872 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 388/798] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:42:12 2022] DELETE /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments/aed13005-5c5b-4f3e-a6f0-d30efaa475b7 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:42:12.947928 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a5b76314-7fec-4605-866e-bf28cf6dcfc2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:12.949371 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a5b76314-7fec-4605-866e-bf28cf6dcfc2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:12.957630 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5b76314-7fec-4605-866e-bf28cf6dcfc2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:12.958086 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5b76314-7fec-4605-866e-bf28cf6dcfc2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:12.959214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5b76314-7fec-4605-866e-bf28cf6dcfc2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:12.959831 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5b76314-7fec-4605-866e-bf28cf6dcfc2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:13.003009 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a5b76314-7fec-4605-866e-bf28cf6dcfc2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061058 Jun 02 13:42:13.003952 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 411/799] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:42:12 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:13.439176 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4b6a02f7-91ee-4a8e-b356-205f05ee8a25 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'create', calling method: .version_select at 0x7f8614ffc1f0>, body: {"keypair": {"name": "tempest-keypair-918455951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCDwvG/yDSJ9RIg0UmpghZHy7AKBNtQ8OQqboG1ew54TOp5NuNRD+flKmqkf5Im3lgn4dH1veZyTB/EA26sa+Ur8MZJXKHC/oTkWh3IbNYkoACr8TULvbje6vV7B/kFkw=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:13.454660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-4b6a02f7-91ee-4a8e-b356-205f05ee8a25 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Getting quotas for project 39255fa001f44b29a23006adf9c1a10d. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:42:13.459366 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-4b6a02f7-91ee-4a8e-b356-205f05ee8a25 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Getting quotas for user 4e88422338024035b5c64d2788965086 and project 39255fa001f44b29a23006adf9c1a10d. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:42:13.483859 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4b6a02f7-91ee-4a8e-b356-205f05ee8a25 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049013 Jun 02 13:42:13.490786 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 389/800] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Jun 2 13:42:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:14.018388 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ae639465-43f6-49a0-bb16-1e7a22f4c611 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:14.020376 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ae639465-43f6-49a0-bb16-1e7a22f4c611 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:14.031524 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae639465-43f6-49a0-bb16-1e7a22f4c611 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:14.033768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae639465-43f6-49a0-bb16-1e7a22f4c611 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:14.037739 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae639465-43f6-49a0-bb16-1e7a22f4c611 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:14.038977 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae639465-43f6-49a0-bb16-1e7a22f4c611 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:14.073536 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ae639465-43f6-49a0-bb16-1e7a22f4c611 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062203 Jun 02 13:42:14.074115 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 412/801] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:42:14 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:42:14.146595 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c859bd07-118e-49c2-9fac-8a894d15b2f4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:14.147566 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c859bd07-118e-49c2-9fac-8a894d15b2f4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:14.156773 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c859bd07-118e-49c2-9fac-8a894d15b2f4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:14.157318 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c859bd07-118e-49c2-9fac-8a894d15b2f4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:14.158157 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c859bd07-118e-49c2-9fac-8a894d15b2f4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:14.158605 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c859bd07-118e-49c2-9fac-8a894d15b2f4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:14.163158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:14.220547 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c859bd07-118e-49c2-9fac-8a894d15b2f4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:42:14.299517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:14.320707 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c859bd07-118e-49c2-9fac-8a894d15b2f4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 204 len: 0 microversion: 2.1 time: 0.178866 Jun 02 13:42:14.321917 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 390/802] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:42:14 2022] DELETE /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:42:14.333193 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fc996d21-45f4-4a27-9d35-10422776553d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:14.334778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fc996d21-45f4-4a27-9d35-10422776553d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:14.346059 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc996d21-45f4-4a27-9d35-10422776553d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:14.346771 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc996d21-45f4-4a27-9d35-10422776553d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:14.348413 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc996d21-45f4-4a27-9d35-10422776553d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:14.349028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc996d21-45f4-4a27-9d35-10422776553d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:14.578096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fc996d21-45f4-4a27-9d35-10422776553d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:14.585661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fc996d21-45f4-4a27-9d35-10422776553d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1680 microversion: 2.1 time: 0.259657 Jun 02 13:42:14.586847 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 413/803] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:14 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:15.236122 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1214986122", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb683ea3-68dc-4328-b475-e935cfb92acc"}], "security_groups": [{"name": "tempest-securitygroup--955420703"}], "key_name": "tempest-keypair-918455951", "user_data": "}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:15.343201 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] validate_networks() for [('cb683ea3-68dc-4328-b475-e935cfb92acc', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:42:15.604957 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-187d4f15-164d-490b-bbfe-1a700410683b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:15.606182 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-187d4f15-164d-490b-bbfe-1a700410683b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:15.614898 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-187d4f15-164d-490b-bbfe-1a700410683b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:15.615717 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-187d4f15-164d-490b-bbfe-1a700410683b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:15.617544 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-187d4f15-164d-490b-bbfe-1a700410683b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:15.618357 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-187d4f15-164d-490b-bbfe-1a700410683b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:15.855923 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-187d4f15-164d-490b-bbfe-1a700410683b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:15.894799 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:42:15.895200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-187d4f15-164d-490b-bbfe-1a700410683b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1680 microversion: 2.1 time: 0.291942 Jun 02 13:42:15.895503 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:42:15.896102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:42:15.896737 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:42:15.897272 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:42:15.905797 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 414/804] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:15 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1680 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:15.908179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:15.908738 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:15.911143 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:15.911324 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e020f8a4-1a74-4c8d-ad7d-fb23f7d1b93d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:15.912072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:15.912485 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e020f8a4-1a74-4c8d-ad7d-fb23f7d1b93d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:15.919806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e020f8a4-1a74-4c8d-ad7d-fb23f7d1b93d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:15.920263 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e020f8a4-1a74-4c8d-ad7d-fb23f7d1b93d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:15.921324 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e020f8a4-1a74-4c8d-ad7d-fb23f7d1b93d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:15.922140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e020f8a4-1a74-4c8d-ad7d-fb23f7d1b93d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:15.938007 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Getting quotas for project 39255fa001f44b29a23006adf9c1a10d. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:42:15.942707 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Getting quotas for user 4e88422338024035b5c64d2788965086 and project 39255fa001f44b29a23006adf9c1a10d. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:42:15.960503 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:42:15.963559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:42:15.969416 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e020f8a4-1a74-4c8d-ad7d-fb23f7d1b93d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:42:16.072340 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fa18f13b-fad3-4632-ac5d-dd8e95fccd72 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.840633 Jun 02 13:42:16.073389 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e020f8a4-1a74-4c8d-ad7d-fb23f7d1b93d tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "DELETE /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 204 len: 0 microversion: 2.1 time: 0.165973 Jun 02 13:42:16.073810 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 391/805] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:42:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:42:16.074444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 415/806] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:42:15 2022] DELETE /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:42:16.083316 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a57c844c-19f3-4fd0-b77d-a405ab2d10df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:16.084744 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a57c844c-19f3-4fd0-b77d-a405ab2d10df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:16.085079 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f4139ae3-6b1e-4221-870c-0f7fe4a654b8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:16.085809 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f4139ae3-6b1e-4221-870c-0f7fe4a654b8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:16.093372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a57c844c-19f3-4fd0-b77d-a405ab2d10df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:16.094141 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a57c844c-19f3-4fd0-b77d-a405ab2d10df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:16.095117 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a57c844c-19f3-4fd0-b77d-a405ab2d10df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:16.095729 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a57c844c-19f3-4fd0-b77d-a405ab2d10df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:16.209560 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f4139ae3-6b1e-4221-870c-0f7fe4a654b8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:16.227610 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f4139ae3-6b1e-4221-870c-0f7fe4a654b8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1237 microversion: 2.1 time: 0.147519 Jun 02 13:42:16.232371 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 416/807] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:16 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1237 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:16.363784 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a57c844c-19f3-4fd0-b77d-a405ab2d10df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:16.373845 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a57c844c-19f3-4fd0-b77d-a405ab2d10df tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1508 microversion: 2.1 time: 0.294818 Jun 02 13:42:16.376377 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 392/808] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:16 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:16.912768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c575142e-8319-4fe0-aa85-a1ce10518ca4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:16.913407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c575142e-8319-4fe0-aa85-a1ce10518ca4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:16.921540 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c575142e-8319-4fe0-aa85-a1ce10518ca4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:16.921989 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c575142e-8319-4fe0-aa85-a1ce10518ca4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:16.922769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c575142e-8319-4fe0-aa85-a1ce10518ca4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:16.923201 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c575142e-8319-4fe0-aa85-a1ce10518ca4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:17.065314 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c575142e-8319-4fe0-aa85-a1ce10518ca4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:17.073765 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c575142e-8319-4fe0-aa85-a1ce10518ca4 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1680 microversion: 2.1 time: 0.165006 Jun 02 13:42:17.074358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 417/809] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:16 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:17.249333 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-77d79bf4-d8dd-42be-a7a1-e4236a3bff55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:17.250092 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-77d79bf4-d8dd-42be-a7a1-e4236a3bff55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:17.257163 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77d79bf4-d8dd-42be-a7a1-e4236a3bff55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:17.257617 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77d79bf4-d8dd-42be-a7a1-e4236a3bff55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:17.258386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77d79bf4-d8dd-42be-a7a1-e4236a3bff55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:17.258822 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77d79bf4-d8dd-42be-a7a1-e4236a3bff55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:17.319834 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-77d79bf4-d8dd-42be-a7a1-e4236a3bff55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:17.327371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-77d79bf4-d8dd-42be-a7a1-e4236a3bff55 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1241 microversion: 2.1 time: 0.081925 Jun 02 13:42:17.328283 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 393/810] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:17 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:17.391034 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9190ae5e-f0ad-4ea1-afe8-cff1609329b3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:17.391736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9190ae5e-f0ad-4ea1-afe8-cff1609329b3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:17.397780 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9190ae5e-f0ad-4ea1-afe8-cff1609329b3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:17.398296 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9190ae5e-f0ad-4ea1-afe8-cff1609329b3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:17.399059 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9190ae5e-f0ad-4ea1-afe8-cff1609329b3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:17.399498 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9190ae5e-f0ad-4ea1-afe8-cff1609329b3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:17.537834 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9190ae5e-f0ad-4ea1-afe8-cff1609329b3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:17.545662 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9190ae5e-f0ad-4ea1-afe8-cff1609329b3 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1508 microversion: 2.1 time: 0.158393 Jun 02 13:42:17.546366 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 418/811] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:17 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:18.091040 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-051ff663-03dd-4750-9e55-f4033c58abca tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:18.091654 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-051ff663-03dd-4750-9e55-f4033c58abca tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:18.098418 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-051ff663-03dd-4750-9e55-f4033c58abca tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:18.098883 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-051ff663-03dd-4750-9e55-f4033c58abca tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:18.099766 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-051ff663-03dd-4750-9e55-f4033c58abca tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:18.100209 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-051ff663-03dd-4750-9e55-f4033c58abca tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:18.253459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-051ff663-03dd-4750-9e55-f4033c58abca tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:18.262652 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-051ff663-03dd-4750-9e55-f4033c58abca tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1680 microversion: 2.1 time: 0.175086 Jun 02 13:42:18.263805 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 394/812] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:18 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:18.343630 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-988f9df5-a6ae-4275-a9b5-9b7b1d8599fc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:18.344431 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-988f9df5-a6ae-4275-a9b5-9b7b1d8599fc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:18.351269 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-988f9df5-a6ae-4275-a9b5-9b7b1d8599fc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:18.351895 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-988f9df5-a6ae-4275-a9b5-9b7b1d8599fc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:18.352852 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-988f9df5-a6ae-4275-a9b5-9b7b1d8599fc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:18.353386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-988f9df5-a6ae-4275-a9b5-9b7b1d8599fc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:18.419927 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-988f9df5-a6ae-4275-a9b5-9b7b1d8599fc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:18.428248 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-988f9df5-a6ae-4275-a9b5-9b7b1d8599fc tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1233 microversion: 2.1 time: 0.088575 Jun 02 13:42:18.428845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 419/813] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:18 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:18.563016 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-11250a90-f9f5-40c0-bae0-40837659abad tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:18.564462 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-11250a90-f9f5-40c0-bae0-40837659abad tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:18.572258 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-11250a90-f9f5-40c0-bae0-40837659abad tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:18.573002 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-11250a90-f9f5-40c0-bae0-40837659abad tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:18.574371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-11250a90-f9f5-40c0-bae0-40837659abad tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:18.574960 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-11250a90-f9f5-40c0-bae0-40837659abad tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:18.806950 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-11250a90-f9f5-40c0-bae0-40837659abad tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:18.819279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-11250a90-f9f5-40c0-bae0-40837659abad tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1508 microversion: 2.1 time: 0.259952 Jun 02 13:42:18.820692 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 395/814] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:18 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:19.288968 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-451da24c-cf87-4b79-80f6-a161df88f851 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:19.289866 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-451da24c-cf87-4b79-80f6-a161df88f851 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:19.306943 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-451da24c-cf87-4b79-80f6-a161df88f851 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:19.312627 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-451da24c-cf87-4b79-80f6-a161df88f851 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:19.313752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-451da24c-cf87-4b79-80f6-a161df88f851 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:19.314296 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-451da24c-cf87-4b79-80f6-a161df88f851 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:19.363369 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:19.447833 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a89f3384-0231-4f95-adda-c660ed73e4e9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:19.449521 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a89f3384-0231-4f95-adda-c660ed73e4e9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:19.466431 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-451da24c-cf87-4b79-80f6-a161df88f851 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:19.467169 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a89f3384-0231-4f95-adda-c660ed73e4e9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:19.468101 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a89f3384-0231-4f95-adda-c660ed73e4e9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:19.471454 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a89f3384-0231-4f95-adda-c660ed73e4e9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:19.472012 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a89f3384-0231-4f95-adda-c660ed73e4e9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:19.480013 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-451da24c-cf87-4b79-80f6-a161df88f851 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1614 microversion: 2.1 time: 0.201646 Jun 02 13:42:19.490830 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 420/815] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:19 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1614 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:19.579317 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a89f3384-0231-4f95-adda-c660ed73e4e9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:19.588769 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a89f3384-0231-4f95-adda-c660ed73e4e9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1295 microversion: 2.1 time: 0.146122 Jun 02 13:42:19.596479 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 396/816] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:19 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1295 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:19.837863 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c26002ee-4c6c-4c39-8757-1fef051c9616 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:19.838581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c26002ee-4c6c-4c39-8757-1fef051c9616 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:19.845455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c26002ee-4c6c-4c39-8757-1fef051c9616 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:19.846062 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c26002ee-4c6c-4c39-8757-1fef051c9616 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:19.847566 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c26002ee-4c6c-4c39-8757-1fef051c9616 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:19.848277 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c26002ee-4c6c-4c39-8757-1fef051c9616 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:20.027797 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-f6a0ab33-daad-4b14-ba57-d3945ddd37e0 req-213ee5b7-a12c-4c25-b370-80cea4cf4e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d660d9e5-4816-47f4-b60a-922f53b35cd2", "name": "network-vif-deleted", "tag": "134a0cd2-dac2-45ac-9b9d-f77942327b3a"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:20.045723 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-f6a0ab33-daad-4b14-ba57-d3945ddd37e0 req-213ee5b7-a12c-4c25-b370-80cea4cf4e44 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:20.047320 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-f6a0ab33-daad-4b14-ba57-d3945ddd37e0 req-213ee5b7-a12c-4c25-b370-80cea4cf4e44 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:20.076290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-f6a0ab33-daad-4b14-ba57-d3945ddd37e0 req-213ee5b7-a12c-4c25-b370-80cea4cf4e44 service nova] Creating event network-vif-deleted:134a0cd2-dac2-45ac-9b9d-f77942327b3a for instance d660d9e5-4816-47f4-b60a-922f53b35cd2 on hv-cinder-83608 Jun 02 13:42:20.083129 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-f6a0ab33-daad-4b14-ba57-d3945ddd37e0 req-213ee5b7-a12c-4c25-b370-80cea4cf4e44 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067127 Jun 02 13:42:20.088036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 397/817] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:20.138594 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c26002ee-4c6c-4c39-8757-1fef051c9616 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:20.147814 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c26002ee-4c6c-4c39-8757-1fef051c9616 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1508 microversion: 2.1 time: 0.314089 Jun 02 13:42:20.148470 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 421/818] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:19 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:20.500979 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:20.501827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:20.516319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:20.517069 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:20.518257 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:20.519010 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:20.585175 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:20.586027 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:20.586737 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lazy-loading 'fault' on Instance uuid d660d9e5-4816-47f4-b60a-922f53b35cd2 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:42:20.611016 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-20d06b9c-eaa6-4dc7-8593-dbe195c7720a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:20.612655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-20d06b9c-eaa6-4dc7-8593-dbe195c7720a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:20.625533 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20d06b9c-eaa6-4dc7-8593-dbe195c7720a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:20.630075 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20d06b9c-eaa6-4dc7-8593-dbe195c7720a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:20.631253 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20d06b9c-eaa6-4dc7-8593-dbe195c7720a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:20.631926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-20d06b9c-eaa6-4dc7-8593-dbe195c7720a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:20.776189 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:20.787161 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8d131136-471a-4578-b5c1-e13502ccf605 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 200 len: 1331 microversion: 2.1 time: 0.292110 Jun 02 13:42:20.798004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 398/819] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:20 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 1331 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:21.174109 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:21.174734 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:21.183830 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:21.184968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:21.186451 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:21.187980 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:21.235986 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:21.236474 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:21.236938 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lazy-loading 'fault' on Instance uuid 236e7657-e603-49d7-bd47-12254338360f {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:42:21.367271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:21.376021 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-81a2802f-396f-4b53-968b-bf0e969d3de7 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 200 len: 1311 microversion: 2.1 time: 0.215508 Jun 02 13:42:21.377085 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 399/820] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:21 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 1311 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:21.399274 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-20d06b9c-eaa6-4dc7-8593-dbe195c7720a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:21.410064 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-20d06b9c-eaa6-4dc7-8593-dbe195c7720a tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1362 microversion: 2.1 time: 0.804186 Jun 02 13:42:21.411029 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 422/821] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:20 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1362 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:21.816446 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-55386d1b-8970-49fd-a73c-fe59cda574a8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:21.818276 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-55386d1b-8970-49fd-a73c-fe59cda574a8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:21.825309 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55386d1b-8970-49fd-a73c-fe59cda574a8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:21.826417 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55386d1b-8970-49fd-a73c-fe59cda574a8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:21.828124 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55386d1b-8970-49fd-a73c-fe59cda574a8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:21.829064 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-55386d1b-8970-49fd-a73c-fe59cda574a8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:21.845003 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-55386d1b-8970-49fd-a73c-fe59cda574a8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-55386d1b-8970-49fd-a73c-fe59cda574a8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 HTTP/1.1 Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:42:21.847034 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:42:21.848957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': 'd660d9e5-4816-47f4-b60a-922f53b35cd2'} Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:42:21.849711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:42:21.850939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:21.853645 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-55386d1b-8970-49fd-a73c-fe59cda574a8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:42:21.856220 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-55386d1b-8970-49fd-a73c-fe59cda574a8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 404 len: 111 microversion: 2.1 time: 0.042305 Jun 02 13:42:21.857374 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 400/822] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:21 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:42:21.866500 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a53de60d-292b-4055-93dc-7aae78562288 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '.version_select at 0x7f8614e3b430>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:21.897931 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a53de60d-292b-4055-93dc-7aae78562288 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530991509" status: 202 len: 0 microversion: 2.1 time: 0.036121 Jun 02 13:42:21.901462 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 423/823] 10.222.0.32 () {58 vars in 1217 bytes} [Thu Jun 2 13:42:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530991509 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:42:21.979470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-48a40cbd-9eff-45bf-b8ae-94365f05de6c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:21.980699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-48a40cbd-9eff-45bf-b8ae-94365f05de6c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:21.991810 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48a40cbd-9eff-45bf-b8ae-94365f05de6c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:21.992679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48a40cbd-9eff-45bf-b8ae-94365f05de6c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:21.994766 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48a40cbd-9eff-45bf-b8ae-94365f05de6c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:21.995634 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48a40cbd-9eff-45bf-b8ae-94365f05de6c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.044709 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-48a40cbd-9eff-45bf-b8ae-94365f05de6c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/ips" status: 200 len: 152 microversion: 2.20 time: 0.072473 Jun 02 13:42:22.046129 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 401/824] 10.222.0.32 () {60 vars in 1288 bytes} [Thu Jun 2 13:42:21 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/ips => generated 152 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:42:22.145947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-dcd35710-c6a2-4f98-afd5-cadb9a331b32 req-c9767dc3-363d-4c9c-a6c9-f73d5f1a92a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feaca659-ff17-4177-bb50-c7475b2d2beb", "tag": "cf2c6b43-4d83-4ce3-ac62-55fe9f7dbc4d"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:22.161463 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-dcd35710-c6a2-4f98-afd5-cadb9a331b32 req-c9767dc3-363d-4c9c-a6c9-f73d5f1a92a4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:22.162457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-dcd35710-c6a2-4f98-afd5-cadb9a331b32 req-c9767dc3-363d-4c9c-a6c9-f73d5f1a92a4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.189335 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-af38d6f8-7e6b-4d52-a6ac-497cf832d500 req-9443e6f5-f3bd-46f3-afe9-90dba13deea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236e7657-e603-49d7-bd47-12254338360f", "name": "network-vif-deleted", "tag": "791691ca-0e7d-4a40-afe0-33e7d2ffdc07"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:22.192291 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-dcd35710-c6a2-4f98-afd5-cadb9a331b32 req-c9767dc3-363d-4c9c-a6c9-f73d5f1a92a4 service nova] Creating event network-changed:cf2c6b43-4d83-4ce3-ac62-55fe9f7dbc4d for instance feaca659-ff17-4177-bb50-c7475b2d2beb on hv-cinder-83608 Jun 02 13:42:22.209131 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-af38d6f8-7e6b-4d52-a6ac-497cf832d500 req-9443e6f5-f3bd-46f3-afe9-90dba13deea3 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:22.209877 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-af38d6f8-7e6b-4d52-a6ac-497cf832d500 req-9443e6f5-f3bd-46f3-afe9-90dba13deea3 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.210150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-dcd35710-c6a2-4f98-afd5-cadb9a331b32 req-c9767dc3-363d-4c9c-a6c9-f73d5f1a92a4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068328 Jun 02 13:42:22.210881 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 424/825] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:22.250878 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-af38d6f8-7e6b-4d52-a6ac-497cf832d500 req-9443e6f5-f3bd-46f3-afe9-90dba13deea3 service nova] Creating event network-vif-deleted:791691ca-0e7d-4a40-afe0-33e7d2ffdc07 for instance 236e7657-e603-49d7-bd47-12254338360f on hv-cinder-83608 Jun 02 13:42:22.264154 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-af38d6f8-7e6b-4d52-a6ac-497cf832d500 req-9443e6f5-f3bd-46f3-afe9-90dba13deea3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079758 Jun 02 13:42:22.266317 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 402/826] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:22.395482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0a24395a-c4e5-4443-a85e-10a18131db22 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:22.399540 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0a24395a-c4e5-4443-a85e-10a18131db22 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: 236e7657-e603-49d7-bd47-12254338360f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:22.408848 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a24395a-c4e5-4443-a85e-10a18131db22 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:22.410403 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a24395a-c4e5-4443-a85e-10a18131db22 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.412956 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a24395a-c4e5-4443-a85e-10a18131db22 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:22.413851 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a24395a-c4e5-4443-a85e-10a18131db22 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.429822 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-70ffe9e0-05c3-4749-8994-23136f62e321 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:22.430651 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-70ffe9e0-05c3-4749-8994-23136f62e321 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:22.466575 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ffe9e0-05c3-4749-8994-23136f62e321 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:22.467710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ffe9e0-05c3-4749-8994-23136f62e321 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.472933 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ffe9e0-05c3-4749-8994-23136f62e321 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:22.479000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ffe9e0-05c3-4749-8994-23136f62e321 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.490825 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-0a24395a-c4e5-4443-a85e-10a18131db22 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] HTTP exception thrown: Instance 236e7657-e603-49d7-bd47-12254338360f could not be found. Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0a24395a-c4e5-4443-a85e-10a18131db22 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Request method failure captured: Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f HTTP/1.1 Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzSOc8zAN0uDeWOclgH-FIpci9Nk5ZltTZPNxM6Pkn07DHpAN-kLw8-tMMyEZ8olBGqS-_Vv3DH24STayy7hBz2mdCS88fQh0x5WYzrT0SJLDNGvis67219B7mMEZOwSIQ5eMGU1j2HAUo9dRY8qVWWRNCbB-LBVVcpQX5WGbiIlnM Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: ff89a4ee01d444d2aee3bdc9199d556f Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:42:22.494868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ff89a4ee01d444d2aee3bdc9199d556f"}]}] Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: ff89a4ee01d444d2aee3bdc9199d556f Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-ServerRescueNegativeTestJSON-632983293-project Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: b92da35ea7c946ea876b13b13ed98258 Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-ServerRescueNegativeTestJSON-632983293-project Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 236e7657-e603-49d7-bd47-12254338360f could not be found. Jun 02 13:42:22.496589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '236e7657-e603-49d7-bd47-12254338360f'} Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 236e7657-e603-49d7-bd47-12254338360f could not be found. Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:42:22.497529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 236e7657-e603-49d7-bd47-12254338360f could not be found. Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 236e7657-e603-49d7-bd47-12254338360f could not be found. Jun 02 13:42:22.498744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:42:22.509158 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0a24395a-c4e5-4443-a85e-10a18131db22 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Returning 404 to user: Instance 236e7657-e603-49d7-bd47-12254338360f could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:42:22.512710 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0a24395a-c4e5-4443-a85e-10a18131db22 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f" status: 404 len: 111 microversion: 2.1 time: 0.119391 Jun 02 13:42:22.515724 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 425/827] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:22 2022] GET /compute/v2.1/servers/236e7657-e603-49d7-bd47-12254338360f => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:42:22.526746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b327002a-cb66-4f03-a6ef-e72b19f84c76 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:22.527258 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b327002a-cb66-4f03-a6ef-e72b19f84c76 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:22.548580 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b327002a-cb66-4f03-a6ef-e72b19f84c76 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:22.551372 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b327002a-cb66-4f03-a6ef-e72b19f84c76 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.552761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b327002a-cb66-4f03-a6ef-e72b19f84c76 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:22.556479 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b327002a-cb66-4f03-a6ef-e72b19f84c76 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.615280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b327002a-cb66-4f03-a6ef-e72b19f84c76 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:42:22.723382 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:22.759686 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b327002a-cb66-4f03-a6ef-e72b19f84c76 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 204 len: 0 microversion: 2.1 time: 0.240348 Jun 02 13:42:22.760924 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 426/828] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:42:22 2022] DELETE /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:42:22.770381 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-892a3dbe-832b-4e59-9808-c365330343a0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:22.771444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-892a3dbe-832b-4e59-9808-c365330343a0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:22.780131 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-892a3dbe-832b-4e59-9808-c365330343a0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:22.780852 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-892a3dbe-832b-4e59-9808-c365330343a0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.781947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-892a3dbe-832b-4e59-9808-c365330343a0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:22.782779 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-892a3dbe-832b-4e59-9808-c365330343a0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:22.908433 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70ffe9e0-05c3-4749-8994-23136f62e321 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:22.916811 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-70ffe9e0-05c3-4749-8994-23136f62e321 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1362 microversion: 2.1 time: 0.493457 Jun 02 13:42:22.917381 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 403/829] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:22 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1362 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:23.004382 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-892a3dbe-832b-4e59-9808-c365330343a0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:23.012978 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-892a3dbe-832b-4e59-9808-c365330343a0 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.247893 Jun 02 13:42:23.014009 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 427/830] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:22 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:23.201302 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-abae170b-1443-40ea-8386-06b9f2c74c8a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: .version_select at 0x7f861504a5e0>, body: {"keypair": {"name": "tempest-keypair-633971284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2Eyckk+f6bvYyM7To19J2YQvg32vOUXQwwXIc7SKdI7y0W2O4zKAb+Zy74n0sIiRpca4h3XIFEftP7BQkd8WZ1NxzX4zcTouhV8aQqAieJeVRD9utEhPMr62iiEhHFOA=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:23.222177 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-abae170b-1443-40ea-8386-06b9f2c74c8a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:42:23.227146 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-abae170b-1443-40ea-8386-06b9f2c74c8a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for user a1622acb057f419ca98e7d44584c276d and project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:42:23.254218 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-abae170b-1443-40ea-8386-06b9f2c74c8a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057109 Jun 02 13:42:23.255287 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 404/831] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Jun 2 13:42:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:23.312586 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c7e3293f-a23d-48e5-8a65-e6266f061edd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:23.313408 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c7e3293f-a23d-48e5-8a65-e6266f061edd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:23.322952 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7e3293f-a23d-48e5-8a65-e6266f061edd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:23.323903 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7e3293f-a23d-48e5-8a65-e6266f061edd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:23.325027 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7e3293f-a23d-48e5-8a65-e6266f061edd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:23.325691 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7e3293f-a23d-48e5-8a65-e6266f061edd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:23.362015 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-c7e3293f-a23d-48e5-8a65-e6266f061edd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lazy-loading 'flavor' on Instance uuid 38561783-c8ae-4094-b4c9-419507739f61 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:42:23.451251 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c7e3293f-a23d-48e5-8a65-e6266f061edd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "POST /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61/action" status: 202 len: 0 microversion: 2.1 time: 0.142366 Jun 02 13:42:23.451836 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 428/832] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:42:23 2022] POST /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:42:23.461300 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c7b2c0a6-6366-4662-ac59-5b35fad01a3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:23.462114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c7b2c0a6-6366-4662-ac59-5b35fad01a3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:23.468315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c7b2c0a6-6366-4662-ac59-5b35fad01a3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:23.469383 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c7b2c0a6-6366-4662-ac59-5b35fad01a3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:23.469728 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c7b2c0a6-6366-4662-ac59-5b35fad01a3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:23.470257 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c7b2c0a6-6366-4662-ac59-5b35fad01a3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:23.669621 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c7b2c0a6-6366-4662-ac59-5b35fad01a3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:23.680095 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c7b2c0a6-6366-4662-ac59-5b35fad01a3c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.223361 Jun 02 13:42:23.681134 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 405/833] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:23 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:23.936617 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-22ddcc8d-e5a4-4344-b481-8091c2a08fa0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:23.937190 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-22ddcc8d-e5a4-4344-b481-8091c2a08fa0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:23.946756 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ddcc8d-e5a4-4344-b481-8091c2a08fa0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:23.948324 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ddcc8d-e5a4-4344-b481-8091c2a08fa0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:23.949307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ddcc8d-e5a4-4344-b481-8091c2a08fa0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:23.950698 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ddcc8d-e5a4-4344-b481-8091c2a08fa0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:24.032644 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-db136674-c4e7-4995-9605-a200462ee260 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:24.033274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-db136674-c4e7-4995-9605-a200462ee260 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:24.042156 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db136674-c4e7-4995-9605-a200462ee260 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:24.042638 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db136674-c4e7-4995-9605-a200462ee260 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:24.043470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db136674-c4e7-4995-9605-a200462ee260 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:24.043906 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db136674-c4e7-4995-9605-a200462ee260 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:24.270936 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-22ddcc8d-e5a4-4344-b481-8091c2a08fa0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:24.280174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-22ddcc8d-e5a4-4344-b481-8091c2a08fa0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1362 microversion: 2.1 time: 0.349161 Jun 02 13:42:24.288938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 429/834] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:23 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:24.294527 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8300394c-147e-46aa-b29b-e285729eaa58 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:24.295081 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8300394c-147e-46aa-b29b-e285729eaa58 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:24.304974 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8300394c-147e-46aa-b29b-e285729eaa58 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:24.305778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8300394c-147e-46aa-b29b-e285729eaa58 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:24.306593 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8300394c-147e-46aa-b29b-e285729eaa58 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:24.307057 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8300394c-147e-46aa-b29b-e285729eaa58 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:24.332415 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-8300394c-147e-46aa-b29b-e285729eaa58 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lazy-loading 'flavor' on Instance uuid 5608f7cb-9e96-4916-87e2-1f6efd94cae1 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:42:24.361318 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-db136674-c4e7-4995-9605-a200462ee260 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:24.372606 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-db136674-c4e7-4995-9605-a200462ee260 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.345577 Jun 02 13:42:24.382485 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 406/835] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:24 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:24.609359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8300394c-147e-46aa-b29b-e285729eaa58 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "POST /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/action" status: 202 len: 0 microversion: 2.20 time: 0.318713 Jun 02 13:42:24.610142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 430/836] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Jun 2 13:42:24 2022] POST /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:42:24.618204 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-46a31548-bc22-49d2-9bd0-0d67271d2985 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:24.629319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-46a31548-bc22-49d2-9bd0-0d67271d2985 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:24.641806 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-46a31548-bc22-49d2-9bd0-0d67271d2985 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:24.642271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-46a31548-bc22-49d2-9bd0-0d67271d2985 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:24.643070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-46a31548-bc22-49d2-9bd0-0d67271d2985 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:24.643589 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-46a31548-bc22-49d2-9bd0-0d67271d2985 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:24.699204 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9156e9e2-d1ae-4931-bc66-63d356d084ac tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:24.700478 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9156e9e2-d1ae-4931-bc66-63d356d084ac tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:24.709787 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9156e9e2-d1ae-4931-bc66-63d356d084ac tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:24.710428 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9156e9e2-d1ae-4931-bc66-63d356d084ac tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:24.711402 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9156e9e2-d1ae-4931-bc66-63d356d084ac tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:24.711972 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9156e9e2-d1ae-4931-bc66-63d356d084ac tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:24.995619 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-46a31548-bc22-49d2-9bd0-0d67271d2985 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:25.003798 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-46a31548-bc22-49d2-9bd0-0d67271d2985 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:25.005416 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-46a31548-bc22-49d2-9bd0-0d67271d2985 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:25.006936 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-46a31548-bc22-49d2-9bd0-0d67271d2985 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.392574 Jun 02 13:42:25.018422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 407/837] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:24 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:25.074322 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9156e9e2-d1ae-4931-bc66-63d356d084ac tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:25.082288 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9156e9e2-d1ae-4931-bc66-63d356d084ac tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.387865 Jun 02 13:42:25.082871 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 431/838] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:24 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:25.308457 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e4b47c78-9cd6-4beb-a469-e68d2d6bc0d5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:25.309084 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e4b47c78-9cd6-4beb-a469-e68d2d6bc0d5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:25.311641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-33414755", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4dbc7e40-4f9d-4008-913e-157e6f3d947d"}], "security_groups": [{"name": "tempest-securitygroup--395573096"}], "key_name": "tempest-keypair-633971284", "user_data": "}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:25.315700 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4b47c78-9cd6-4beb-a469-e68d2d6bc0d5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:25.316191 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4b47c78-9cd6-4beb-a469-e68d2d6bc0d5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:25.317008 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4b47c78-9cd6-4beb-a469-e68d2d6bc0d5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:25.317449 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4b47c78-9cd6-4beb-a469-e68d2d6bc0d5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:25.338743 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:25.462367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] validate_networks() for [('4dbc7e40-4f9d-4008-913e-157e6f3d947d', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:42:25.542406 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e4b47c78-9cd6-4beb-a469-e68d2d6bc0d5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:25.551713 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e4b47c78-9cd6-4beb-a469-e68d2d6bc0d5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1362 microversion: 2.1 time: 0.248305 Jun 02 13:42:25.552370 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 408/839] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:25 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:25.556744 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-17c63ae1-67b3-4c58-95d9-666abceba1e1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:25.557580 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-17c63ae1-67b3-4c58-95d9-666abceba1e1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:25.564360 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17c63ae1-67b3-4c58-95d9-666abceba1e1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:25.564818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17c63ae1-67b3-4c58-95d9-666abceba1e1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:25.565631 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17c63ae1-67b3-4c58-95d9-666abceba1e1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:25.566656 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17c63ae1-67b3-4c58-95d9-666abceba1e1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:25.751663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-17c63ae1-67b3-4c58-95d9-666abceba1e1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:25.761321 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-17c63ae1-67b3-4c58-95d9-666abceba1e1 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.207921 Jun 02 13:42:25.761892 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 409/840] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:25 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:26.002826 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:42:26.003308 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:42:26.003847 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:42:26.004255 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:42:26.004727 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:42:26.013936 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:26.014461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:26.015333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:26.015839 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:26.025725 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5f96aa4c-8f22-4545-923b-8e56acab2b05 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:26.026491 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5f96aa4c-8f22-4545-923b-8e56acab2b05 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:26.028355 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:26.033747 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f96aa4c-8f22-4545-923b-8e56acab2b05 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:26.034221 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f96aa4c-8f22-4545-923b-8e56acab2b05 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:26.035580 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f96aa4c-8f22-4545-923b-8e56acab2b05 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:26.036025 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f96aa4c-8f22-4545-923b-8e56acab2b05 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:26.036654 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:42:26.040723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Getting quotas for user a1622acb057f419ca98e7d44584c276d and project e2a60aa73c3943e18fea2b2f38fadffe. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:42:26.054300 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:42:26.056532 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:42:26.105719 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7d192b38-33e7-4751-8bc0-e70266680b6d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.798238 Jun 02 13:42:26.111427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 432/841] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:42:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 13:42:26.111427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f547ee3f-aa0b-4fe4-9395-9775c4cfd8de tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:26.111817 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f547ee3f-aa0b-4fe4-9395-9775c4cfd8de tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:26.118593 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f547ee3f-aa0b-4fe4-9395-9775c4cfd8de tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:26.119050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f547ee3f-aa0b-4fe4-9395-9775c4cfd8de tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:26.119834 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f547ee3f-aa0b-4fe4-9395-9775c4cfd8de tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:26.120277 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f547ee3f-aa0b-4fe4-9395-9775c4cfd8de tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:26.232929 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5f96aa4c-8f22-4545-923b-8e56acab2b05 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:26.243117 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5f96aa4c-8f22-4545-923b-8e56acab2b05 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:26.244769 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5f96aa4c-8f22-4545-923b-8e56acab2b05 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:26.245951 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5f96aa4c-8f22-4545-923b-8e56acab2b05 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.224134 Jun 02 13:42:26.256798 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 410/842] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:26 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:42:26.262738 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5a4e386a-b8c3-4c31-bd2f-e0b08f0addc7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:26.263373 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5a4e386a-b8c3-4c31-bd2f-e0b08f0addc7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:26.284072 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f547ee3f-aa0b-4fe4-9395-9775c4cfd8de tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:26.293959 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f547ee3f-aa0b-4fe4-9395-9775c4cfd8de tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.186428 Jun 02 13:42:26.294546 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 433/843] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:26 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:26.341876 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5a4e386a-b8c3-4c31-bd2f-e0b08f0addc7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:26.348949 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5a4e386a-b8c3-4c31-bd2f-e0b08f0addc7 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1239 microversion: 2.1 time: 0.091047 Jun 02 13:42:26.349521 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 411/844] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:26 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:26.569231 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f158a25d-48cb-4f0d-90b9-99492cccbcb3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:26.571080 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f158a25d-48cb-4f0d-90b9-99492cccbcb3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:26.579852 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f158a25d-48cb-4f0d-90b9-99492cccbcb3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:26.580494 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f158a25d-48cb-4f0d-90b9-99492cccbcb3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:26.581283 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f158a25d-48cb-4f0d-90b9-99492cccbcb3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:26.581925 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f158a25d-48cb-4f0d-90b9-99492cccbcb3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:26.613514 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:26.778980 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-20908912-f633-4354-bb2a-e0f973ce52f8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:26.779258 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-20908912-f633-4354-bb2a-e0f973ce52f8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:26.785822 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20908912-f633-4354-bb2a-e0f973ce52f8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:26.786557 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20908912-f633-4354-bb2a-e0f973ce52f8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:26.788030 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20908912-f633-4354-bb2a-e0f973ce52f8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:26.788682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20908912-f633-4354-bb2a-e0f973ce52f8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:26.887681 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f158a25d-48cb-4f0d-90b9-99492cccbcb3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:26.902325 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f158a25d-48cb-4f0d-90b9-99492cccbcb3 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1362 microversion: 2.1 time: 0.336591 Jun 02 13:42:26.904708 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 434/845] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:26 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:27.022577 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-20908912-f633-4354-bb2a-e0f973ce52f8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92da35ea7c946ea876b13b13ed98258', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff89a4ee01d444d2aee3bdc9199d556f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:27.031736 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-20908912-f633-4354-bb2a-e0f973ce52f8 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 200 len: 1521 microversion: 2.1 time: 0.256974 Jun 02 13:42:27.044653 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 412/846] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:26 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:27.110070 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-71634bae-3682-46ca-ac2d-eb3714672a71 req-7777b5a7-a07d-41d9-910b-c287020827d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82cda25-d51b-490e-9102-3de1f9b9066b", "name": "network-vif-deleted", "tag": "d47c6ac3-a0dd-453a-a639-2012303e854a"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:27.119155 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-71634bae-3682-46ca-ac2d-eb3714672a71 req-7777b5a7-a07d-41d9-910b-c287020827d8 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:27.119590 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-71634bae-3682-46ca-ac2d-eb3714672a71 req-7777b5a7-a07d-41d9-910b-c287020827d8 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:27.131628 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-71634bae-3682-46ca-ac2d-eb3714672a71 req-7777b5a7-a07d-41d9-910b-c287020827d8 service nova] Creating event network-vif-deleted:d47c6ac3-a0dd-453a-a639-2012303e854a for instance c82cda25-d51b-490e-9102-3de1f9b9066b on hv-cinder-83608 Jun 02 13:42:27.136958 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-71634bae-3682-46ca-ac2d-eb3714672a71 req-7777b5a7-a07d-41d9-910b-c287020827d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030464 Jun 02 13:42:27.137535 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 435/847] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:27.269648 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-62ab88d8-c88c-48fb-a07a-24d95906407f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:27.270267 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-62ab88d8-c88c-48fb-a07a-24d95906407f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:27.277523 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-62ab88d8-c88c-48fb-a07a-24d95906407f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:27.277716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-62ab88d8-c88c-48fb-a07a-24d95906407f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:27.278527 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-62ab88d8-c88c-48fb-a07a-24d95906407f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:27.279649 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-62ab88d8-c88c-48fb-a07a-24d95906407f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:27.315208 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-78f72278-d63a-4a94-bf2c-027472065a87 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:27.319365 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-78f72278-d63a-4a94-bf2c-027472065a87 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:27.337573 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-78f72278-d63a-4a94-bf2c-027472065a87 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:27.338205 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-78f72278-d63a-4a94-bf2c-027472065a87 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:27.339005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-78f72278-d63a-4a94-bf2c-027472065a87 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:27.339531 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-78f72278-d63a-4a94-bf2c-027472065a87 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:27.578903 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-62ab88d8-c88c-48fb-a07a-24d95906407f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:27.587602 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-62ab88d8-c88c-48fb-a07a-24d95906407f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:27.589406 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-62ab88d8-c88c-48fb-a07a-24d95906407f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:27.590595 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-62ab88d8-c88c-48fb-a07a-24d95906407f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.325473 Jun 02 13:42:27.591751 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 413/848] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:27 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:27.607710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-88cb21eb-784a-41b3-a315-d972886f2093 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:27.608726 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-88cb21eb-784a-41b3-a315-d972886f2093 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:27.610978 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-78f72278-d63a-4a94-bf2c-027472065a87 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:27.616529 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88cb21eb-784a-41b3-a315-d972886f2093 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:27.617003 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88cb21eb-784a-41b3-a315-d972886f2093 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:27.617860 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88cb21eb-784a-41b3-a315-d972886f2093 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:27.618709 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88cb21eb-784a-41b3-a315-d972886f2093 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:27.619290 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-78f72278-d63a-4a94-bf2c-027472065a87 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.309457 Jun 02 13:42:27.619861 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 436/849] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:27 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:27.683884 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-88cb21eb-784a-41b3-a315-d972886f2093 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:27.692314 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-88cb21eb-784a-41b3-a315-d972886f2093 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1297 microversion: 2.1 time: 0.089059 Jun 02 13:42:27.693074 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 414/850] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:27 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:27.920817 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-962242b1-dc25-4059-b2b9-d7a1f252db3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:27.921609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-962242b1-dc25-4059-b2b9-d7a1f252db3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:27.929793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-962242b1-dc25-4059-b2b9-d7a1f252db3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:27.930252 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-962242b1-dc25-4059-b2b9-d7a1f252db3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:27.931049 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-962242b1-dc25-4059-b2b9-d7a1f252db3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:27.931477 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-962242b1-dc25-4059-b2b9-d7a1f252db3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:28.049792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-66563b79-2436-4274-bc20-cf274bafaa71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:28.050989 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-66563b79-2436-4274-bc20-cf274bafaa71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] [instance: c82cda25-d51b-490e-9102-3de1f9b9066b] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:28.057385 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66563b79-2436-4274-bc20-cf274bafaa71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:28.058290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66563b79-2436-4274-bc20-cf274bafaa71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:28.059082 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66563b79-2436-4274-bc20-cf274bafaa71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:28.059529 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66563b79-2436-4274-bc20-cf274bafaa71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:28.073458 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-66563b79-2436-4274-bc20-cf274bafaa71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] HTTP exception thrown: Instance c82cda25-d51b-490e-9102-3de1f9b9066b could not be found. Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-66563b79-2436-4274-bc20-cf274bafaa71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Request method failure captured: Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b HTTP/1.1 Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzSOc8zAN0uDeWOclgH-FIpci9Nk5ZltTZPNxM6Pkn07DHpAN-kLw8-tMMyEZ8olBGqS-_Vv3DH24STayy7hBz2mdCS88fQh0x5WYzrT0SJLDNGvis67219B7mMEZOwSIQ5eMGU1j2HAUo9dRY8qVWWRNCbB-LBVVcpQX5WGbiIlnM Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: ff89a4ee01d444d2aee3bdc9199d556f Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:42:28.075262 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ff89a4ee01d444d2aee3bdc9199d556f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ff89a4ee01d444d2aee3bdc9199d556f"}]}] Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: ff89a4ee01d444d2aee3bdc9199d556f Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-632983293 Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-ServerRescueNegativeTestJSON-632983293-project Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: b92da35ea7c946ea876b13b13ed98258 Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-ServerRescueNegativeTestJSON-632983293-project Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance c82cda25-d51b-490e-9102-3de1f9b9066b could not be found. Jun 02 13:42:28.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': 'c82cda25-d51b-490e-9102-3de1f9b9066b'} Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82cda25-d51b-490e-9102-3de1f9b9066b could not be found. Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:42:28.077983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82cda25-d51b-490e-9102-3de1f9b9066b could not be found. Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82cda25-d51b-490e-9102-3de1f9b9066b could not be found. Jun 02 13:42:28.079229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:42:28.080465 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-66563b79-2436-4274-bc20-cf274bafaa71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] Returning 404 to user: Instance c82cda25-d51b-490e-9102-3de1f9b9066b could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:42:28.080465 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-66563b79-2436-4274-bc20-cf274bafaa71 tempest-ServerRescueNegativeTestJSON-632983293 tempest-ServerRescueNegativeTestJSON-632983293-project] 10.222.0.32 "GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b" status: 404 len: 111 microversion: 2.1 time: 0.030775 Jun 02 13:42:28.080465 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 415/851] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:28 2022] GET /compute/v2.1/servers/c82cda25-d51b-490e-9102-3de1f9b9066b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:42:28.113907 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-962242b1-dc25-4059-b2b9-d7a1f252db3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:28.122452 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-962242b1-dc25-4059-b2b9-d7a1f252db3e tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1362 microversion: 2.1 time: 0.205433 Jun 02 13:42:28.123269 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 437/852] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:27 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:28.612945 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-00c70676-1392-4e1e-879e-dc18a54c6e2b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:28.614177 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-00c70676-1392-4e1e-879e-dc18a54c6e2b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:28.622046 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00c70676-1392-4e1e-879e-dc18a54c6e2b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:28.622769 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00c70676-1392-4e1e-879e-dc18a54c6e2b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:28.623971 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00c70676-1392-4e1e-879e-dc18a54c6e2b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:28.624631 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00c70676-1392-4e1e-879e-dc18a54c6e2b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:28.637794 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-df7ea055-acc3-427b-b0f0-e4c409261dcd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:28.640177 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-df7ea055-acc3-427b-b0f0-e4c409261dcd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:28.648995 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-df7ea055-acc3-427b-b0f0-e4c409261dcd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:28.654334 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-df7ea055-acc3-427b-b0f0-e4c409261dcd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:28.655385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-df7ea055-acc3-427b-b0f0-e4c409261dcd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:28.655995 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-df7ea055-acc3-427b-b0f0-e4c409261dcd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:29.274041 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-00c70676-1392-4e1e-879e-dc18a54c6e2b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:29.281471 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-df7ea055-acc3-427b-b0f0-e4c409261dcd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:29.284200 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-00c70676-1392-4e1e-879e-dc18a54c6e2b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:29.289925 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-df7ea055-acc3-427b-b0f0-e4c409261dcd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.656734 Jun 02 13:42:29.299914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-00c70676-1392-4e1e-879e-dc18a54c6e2b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:29.299914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-00c70676-1392-4e1e-879e-dc18a54c6e2b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.692488 Jun 02 13:42:29.299914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 416/853] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:28 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:29.302324 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 438/854] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:28 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:29.305827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fd36e9be-4ede-4b28-b66a-6a0270691bc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:29.306519 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fd36e9be-4ede-4b28-b66a-6a0270691bc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:29.314516 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd36e9be-4ede-4b28-b66a-6a0270691bc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:29.314986 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd36e9be-4ede-4b28-b66a-6a0270691bc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:29.316587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd36e9be-4ede-4b28-b66a-6a0270691bc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:29.317044 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd36e9be-4ede-4b28-b66a-6a0270691bc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:29.450404 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-c5565273-e79e-468b-a3c9-23ba46a18218 req-ba3e9e4b-301c-4ade-b9ad-05101ae9bc5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feaca659-ff17-4177-bb50-c7475b2d2beb", "name": "network-vif-plugged", "status": "completed", "tag": "cf2c6b43-4d83-4ce3-ac62-55fe9f7dbc4d"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:29.459230 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-c5565273-e79e-468b-a3c9-23ba46a18218 req-ba3e9e4b-301c-4ade-b9ad-05101ae9bc5b service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:29.459683 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-c5565273-e79e-468b-a3c9-23ba46a18218 req-ba3e9e4b-301c-4ade-b9ad-05101ae9bc5b service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:29.472658 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-c5565273-e79e-468b-a3c9-23ba46a18218 req-ba3e9e4b-301c-4ade-b9ad-05101ae9bc5b service nova] Creating event network-vif-plugged:cf2c6b43-4d83-4ce3-ac62-55fe9f7dbc4d for instance feaca659-ff17-4177-bb50-c7475b2d2beb on hv-cinder-83608 Jun 02 13:42:29.478146 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-c5565273-e79e-468b-a3c9-23ba46a18218 req-ba3e9e4b-301c-4ade-b9ad-05101ae9bc5b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174330 Jun 02 13:42:29.479182 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 439/855] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:29.485034 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2d08e991-959c-4910-b0e2-266a808d70af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:29.485804 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2d08e991-959c-4910-b0e2-266a808d70af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:29.493010 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2d08e991-959c-4910-b0e2-266a808d70af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:29.493715 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2d08e991-959c-4910-b0e2-266a808d70af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:29.494500 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2d08e991-959c-4910-b0e2-266a808d70af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:29.495098 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2d08e991-959c-4910-b0e2-266a808d70af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:29.575999 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fd36e9be-4ede-4b28-b66a-6a0270691bc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:29.585591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fd36e9be-4ede-4b28-b66a-6a0270691bc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1364 microversion: 2.1 time: 0.285164 Jun 02 13:42:29.586661 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 417/856] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:29 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:29.775033 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2d08e991-959c-4910-b0e2-266a808d70af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:29.787139 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2d08e991-959c-4910-b0e2-266a808d70af tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1362 microversion: 2.1 time: 0.306523 Jun 02 13:42:29.788285 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 440/857] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:29 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:29.950385 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-1603dfa9-a9e2-42f7-bce7-bc8fcd34cbb4 req-660fcfdf-083b-4527-9cc4-5c04c747b1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83", "tag": "d1ad1964-f645-4ab1-ab1e-46f1e6771af4"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:29.964671 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-1603dfa9-a9e2-42f7-bce7-bc8fcd34cbb4 req-660fcfdf-083b-4527-9cc4-5c04c747b1b0 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:29.965341 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-1603dfa9-a9e2-42f7-bce7-bc8fcd34cbb4 req-660fcfdf-083b-4527-9cc4-5c04c747b1b0 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:29.986065 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-1603dfa9-a9e2-42f7-bce7-bc8fcd34cbb4 req-660fcfdf-083b-4527-9cc4-5c04c747b1b0 service nova] Creating event network-changed:d1ad1964-f645-4ab1-ab1e-46f1e6771af4 for instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 on hv-cinder-83608 Jun 02 13:42:29.997798 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-1603dfa9-a9e2-42f7-bce7-bc8fcd34cbb4 req-660fcfdf-083b-4527-9cc4-5c04c747b1b0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051073 Jun 02 13:42:29.998745 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 418/858] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:30.307125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-87695b10-1048-4874-9e39-c014e9b8e678 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:30.307891 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-87695b10-1048-4874-9e39-c014e9b8e678 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:30.317281 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-87695b10-1048-4874-9e39-c014e9b8e678 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:30.317947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-87695b10-1048-4874-9e39-c014e9b8e678 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:30.318894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-87695b10-1048-4874-9e39-c014e9b8e678 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:30.319613 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-87695b10-1048-4874-9e39-c014e9b8e678 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:30.321899 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-00cc3c32-69f8-4bec-a50c-ed3054575090 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:30.322730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-00cc3c32-69f8-4bec-a50c-ed3054575090 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:30.330809 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00cc3c32-69f8-4bec-a50c-ed3054575090 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:30.332125 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00cc3c32-69f8-4bec-a50c-ed3054575090 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:30.333188 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00cc3c32-69f8-4bec-a50c-ed3054575090 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:30.333852 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00cc3c32-69f8-4bec-a50c-ed3054575090 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:30.543126 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-87695b10-1048-4874-9e39-c014e9b8e678 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:30.546597 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-00cc3c32-69f8-4bec-a50c-ed3054575090 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:30.551940 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-87695b10-1048-4874-9e39-c014e9b8e678 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.248698 Jun 02 13:42:30.555896 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-00cc3c32-69f8-4bec-a50c-ed3054575090 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:30.557450 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-00cc3c32-69f8-4bec-a50c-ed3054575090 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:30.558621 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-00cc3c32-69f8-4bec-a50c-ed3054575090 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.244339 Jun 02 13:42:30.559171 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 419/859] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:30 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:42:30.560948 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 441/860] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:30 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:30.603440 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-484e896d-f30f-4418-96b6-763155686bc8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:30.604079 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-484e896d-f30f-4418-96b6-763155686bc8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:30.610162 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-484e896d-f30f-4418-96b6-763155686bc8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:30.610690 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-484e896d-f30f-4418-96b6-763155686bc8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:30.611334 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-484e896d-f30f-4418-96b6-763155686bc8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:30.611774 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-484e896d-f30f-4418-96b6-763155686bc8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:30.803915 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ab9e5b46-e5b8-4310-95cd-48b0bf673f06 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:30.804553 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ab9e5b46-e5b8-4310-95cd-48b0bf673f06 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:30.810582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ab9e5b46-e5b8-4310-95cd-48b0bf673f06 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:30.811030 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ab9e5b46-e5b8-4310-95cd-48b0bf673f06 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:30.811801 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ab9e5b46-e5b8-4310-95cd-48b0bf673f06 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:30.812237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ab9e5b46-e5b8-4310-95cd-48b0bf673f06 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:30.830311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-484e896d-f30f-4418-96b6-763155686bc8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:30.842119 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-484e896d-f30f-4418-96b6-763155686bc8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1364 microversion: 2.1 time: 0.242459 Jun 02 13:42:30.842732 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 420/861] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:30 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:30.991613 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ab9e5b46-e5b8-4310-95cd-48b0bf673f06 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:31.004280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ab9e5b46-e5b8-4310-95cd-48b0bf673f06 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1362 microversion: 2.1 time: 0.203489 Jun 02 13:42:31.004985 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 442/862] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:30 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:31.575244 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3862ebf8-c666-4b12-9c91-4a887bb4a412 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:31.575866 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3862ebf8-c666-4b12-9c91-4a887bb4a412 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:31.578278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-097c5875-6229-4745-8b76-e39a0787202c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:31.578983 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-097c5875-6229-4745-8b76-e39a0787202c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:31.588410 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3862ebf8-c666-4b12-9c91-4a887bb4a412 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:31.589054 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3862ebf8-c666-4b12-9c91-4a887bb4a412 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:31.590685 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3862ebf8-c666-4b12-9c91-4a887bb4a412 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:31.591309 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3862ebf8-c666-4b12-9c91-4a887bb4a412 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:31.594307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-097c5875-6229-4745-8b76-e39a0787202c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:31.594766 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-097c5875-6229-4745-8b76-e39a0787202c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:31.595572 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-097c5875-6229-4745-8b76-e39a0787202c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:31.596012 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-097c5875-6229-4745-8b76-e39a0787202c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:31.929170 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3862ebf8-c666-4b12-9c91-4a887bb4a412 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:31.944239 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-097c5875-6229-4745-8b76-e39a0787202c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:31.955300 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-097c5875-6229-4745-8b76-e39a0787202c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:31.956090 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3862ebf8-c666-4b12-9c91-4a887bb4a412 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.390188 Jun 02 13:42:31.957866 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 421/863] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:31 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:31.962585 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-42199fb7-a70d-445e-ac20-93616507d26d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:31.963388 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-42199fb7-a70d-445e-ac20-93616507d26d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:31.967742 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:31.972627 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-42199fb7-a70d-445e-ac20-93616507d26d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:31.972958 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-42199fb7-a70d-445e-ac20-93616507d26d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:31.973610 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-42199fb7-a70d-445e-ac20-93616507d26d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:31.974057 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-42199fb7-a70d-445e-ac20-93616507d26d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:31.976122 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-097c5875-6229-4745-8b76-e39a0787202c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:31.980215 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-097c5875-6229-4745-8b76-e39a0787202c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.407424 Jun 02 13:42:31.981044 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 443/864] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:31 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:32.023584 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ca359bee-5998-484b-8efd-314cb8cf4455 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:32.024331 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ca359bee-5998-484b-8efd-314cb8cf4455 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:32.031691 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca359bee-5998-484b-8efd-314cb8cf4455 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:32.032844 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca359bee-5998-484b-8efd-314cb8cf4455 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:32.035128 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca359bee-5998-484b-8efd-314cb8cf4455 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:32.035589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca359bee-5998-484b-8efd-314cb8cf4455 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:32.265795 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-42199fb7-a70d-445e-ac20-93616507d26d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:32.274153 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-42199fb7-a70d-445e-ac20-93616507d26d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1364 microversion: 2.1 time: 0.315105 Jun 02 13:42:32.274962 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 422/865] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:31 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:32.332029 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ca359bee-5998-484b-8efd-314cb8cf4455 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:32.340357 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ca359bee-5998-484b-8efd-314cb8cf4455 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1548 microversion: 2.1 time: 0.321862 Jun 02 13:42:32.340893 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 444/866] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:32 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1548 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:32.356552 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-07814065-0137-487f-aa09-001564bba2fb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:32.357048 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-07814065-0137-487f-aa09-001564bba2fb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:32.363938 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07814065-0137-487f-aa09-001564bba2fb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:32.364437 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07814065-0137-487f-aa09-001564bba2fb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:32.365223 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07814065-0137-487f-aa09-001564bba2fb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:32.365841 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07814065-0137-487f-aa09-001564bba2fb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:32.450489 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-07814065-0137-487f-aa09-001564bba2fb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097740 Jun 02 13:42:32.451078 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 423/867] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Jun 2 13:42:32 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:32.974142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b1dc9b0d-fa64-4c82-8282-a0be641950c8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:32.974898 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b1dc9b0d-fa64-4c82-8282-a0be641950c8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:32.981422 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1dc9b0d-fa64-4c82-8282-a0be641950c8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:32.982132 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1dc9b0d-fa64-4c82-8282-a0be641950c8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:32.982697 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1dc9b0d-fa64-4c82-8282-a0be641950c8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:32.983140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1dc9b0d-fa64-4c82-8282-a0be641950c8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:33.002894 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2b4f3348-53a0-4cb3-8feb-07674e87ff3e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:33.005707 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2b4f3348-53a0-4cb3-8feb-07674e87ff3e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:33.013114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2b4f3348-53a0-4cb3-8feb-07674e87ff3e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:33.013754 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2b4f3348-53a0-4cb3-8feb-07674e87ff3e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:33.014705 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2b4f3348-53a0-4cb3-8feb-07674e87ff3e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:33.015437 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2b4f3348-53a0-4cb3-8feb-07674e87ff3e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:33.274051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b1dc9b0d-fa64-4c82-8282-a0be641950c8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:33.283338 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b1dc9b0d-fa64-4c82-8282-a0be641950c8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.313541 Jun 02 13:42:33.283947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 445/868] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:32 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:33.292488 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-62db78c4-34b0-4867-883f-24bd71f58056 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:33.292488 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-62db78c4-34b0-4867-883f-24bd71f58056 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:33.297496 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-62db78c4-34b0-4867-883f-24bd71f58056 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:33.298262 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-62db78c4-34b0-4867-883f-24bd71f58056 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:33.299137 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-62db78c4-34b0-4867-883f-24bd71f58056 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:33.299591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-62db78c4-34b0-4867-883f-24bd71f58056 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:33.371431 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2b4f3348-53a0-4cb3-8feb-07674e87ff3e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:33.380537 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2b4f3348-53a0-4cb3-8feb-07674e87ff3e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:33.382018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2b4f3348-53a0-4cb3-8feb-07674e87ff3e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:33.383188 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2b4f3348-53a0-4cb3-8feb-07674e87ff3e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.388098 Jun 02 13:42:33.383756 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 424/869] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:32 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:42:33.485819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-62db78c4-34b0-4867-883f-24bd71f58056 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:33.495147 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-62db78c4-34b0-4867-883f-24bd71f58056 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1364 microversion: 2.1 time: 0.208238 Jun 02 13:42:33.495967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 446/870] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:33 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:33.890423 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-9f159431-a4ee-4d87-b068-9dc39c64d11c req-ba9cec7f-3d78-417a-9747-932e4f860ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feaca659-ff17-4177-bb50-c7475b2d2beb", "tag": "cf2c6b43-4d83-4ce3-ac62-55fe9f7dbc4d"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:33.898786 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-9f159431-a4ee-4d87-b068-9dc39c64d11c req-ba9cec7f-3d78-417a-9747-932e4f860ddd service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:33.899356 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-9f159431-a4ee-4d87-b068-9dc39c64d11c req-ba9cec7f-3d78-417a-9747-932e4f860ddd service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:33.913603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-9f159431-a4ee-4d87-b068-9dc39c64d11c req-ba9cec7f-3d78-417a-9747-932e4f860ddd service nova] Creating event network-changed:cf2c6b43-4d83-4ce3-ac62-55fe9f7dbc4d for instance feaca659-ff17-4177-bb50-c7475b2d2beb on hv-cinder-83608 Jun 02 13:42:33.918788 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-9f159431-a4ee-4d87-b068-9dc39c64d11c req-ba9cec7f-3d78-417a-9747-932e4f860ddd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032279 Jun 02 13:42:33.919590 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 425/871] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:34.302044 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-860301eb-9c5f-4728-90e3-388cbe6897cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:34.303548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-860301eb-9c5f-4728-90e3-388cbe6897cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:34.311577 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-860301eb-9c5f-4728-90e3-388cbe6897cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:34.312225 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-860301eb-9c5f-4728-90e3-388cbe6897cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:34.313300 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-860301eb-9c5f-4728-90e3-388cbe6897cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:34.313980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-860301eb-9c5f-4728-90e3-388cbe6897cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:34.402664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d131b580-fffb-4e52-9ada-06824990b36b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:34.403538 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d131b580-fffb-4e52-9ada-06824990b36b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:34.411591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d131b580-fffb-4e52-9ada-06824990b36b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:34.412287 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d131b580-fffb-4e52-9ada-06824990b36b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:34.413587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d131b580-fffb-4e52-9ada-06824990b36b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:34.414271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d131b580-fffb-4e52-9ada-06824990b36b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:34.583867 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-860301eb-9c5f-4728-90e3-388cbe6897cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:34.593619 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-860301eb-9c5f-4728-90e3-388cbe6897cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.296927 Jun 02 13:42:34.603354 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 447/872] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:34 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:34.608435 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-49688751-76c9-4aad-a484-3acd5b8a5940 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:34.609144 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-49688751-76c9-4aad-a484-3acd5b8a5940 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:34.615691 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49688751-76c9-4aad-a484-3acd5b8a5940 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:34.616358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49688751-76c9-4aad-a484-3acd5b8a5940 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:34.617303 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49688751-76c9-4aad-a484-3acd5b8a5940 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:34.617738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-49688751-76c9-4aad-a484-3acd5b8a5940 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:34.646489 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d131b580-fffb-4e52-9ada-06824990b36b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:34.658157 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d131b580-fffb-4e52-9ada-06824990b36b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:34.659774 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d131b580-fffb-4e52-9ada-06824990b36b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:34.661107 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d131b580-fffb-4e52-9ada-06824990b36b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.262674 Jun 02 13:42:34.662088 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 426/873] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:34 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:42:34.763897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-49688751-76c9-4aad-a484-3acd5b8a5940 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:34.772067 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-49688751-76c9-4aad-a484-3acd5b8a5940 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1364 microversion: 2.1 time: 0.167453 Jun 02 13:42:34.772673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 448/874] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:34 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:35.610694 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d9404e4a-ff42-4aac-95e4-c7b20940cb08 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:35.611285 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d9404e4a-ff42-4aac-95e4-c7b20940cb08 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:35.617990 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9404e4a-ff42-4aac-95e4-c7b20940cb08 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:35.618600 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9404e4a-ff42-4aac-95e4-c7b20940cb08 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:35.619370 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9404e4a-ff42-4aac-95e4-c7b20940cb08 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:35.619804 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9404e4a-ff42-4aac-95e4-c7b20940cb08 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:35.680196 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f58bb17f-c10d-4190-8d80-dfdc8f8d232e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:35.680865 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f58bb17f-c10d-4190-8d80-dfdc8f8d232e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:35.687818 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f58bb17f-c10d-4190-8d80-dfdc8f8d232e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:35.688270 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f58bb17f-c10d-4190-8d80-dfdc8f8d232e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:35.689072 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f58bb17f-c10d-4190-8d80-dfdc8f8d232e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:35.689507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f58bb17f-c10d-4190-8d80-dfdc8f8d232e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:35.911616 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d9404e4a-ff42-4aac-95e4-c7b20940cb08 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:35.919135 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d9404e4a-ff42-4aac-95e4-c7b20940cb08 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.312286 Jun 02 13:42:35.919695 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 427/875] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:35 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:35.925836 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ba41b5fd-2b79-4343-8f55-be32a4472fea tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:35.926441 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ba41b5fd-2b79-4343-8f55-be32a4472fea tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:35.935176 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba41b5fd-2b79-4343-8f55-be32a4472fea tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:35.935730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba41b5fd-2b79-4343-8f55-be32a4472fea tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:35.936550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba41b5fd-2b79-4343-8f55-be32a4472fea tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:35.936988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba41b5fd-2b79-4343-8f55-be32a4472fea tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:35.955737 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:35.963875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f58bb17f-c10d-4190-8d80-dfdc8f8d232e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:35.972459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f58bb17f-c10d-4190-8d80-dfdc8f8d232e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:35.974119 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f58bb17f-c10d-4190-8d80-dfdc8f8d232e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:35.975373 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f58bb17f-c10d-4190-8d80-dfdc8f8d232e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.299141 Jun 02 13:42:35.976026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 449/876] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:35 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:42:36.140052 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ba41b5fd-2b79-4343-8f55-be32a4472fea tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:36.148327 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ba41b5fd-2b79-4343-8f55-be32a4472fea tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1364 microversion: 2.1 time: 0.227365 Jun 02 13:42:36.148922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 428/877] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:35 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:36.937903 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d7dec167-3a34-47f7-93ea-a877b0e72203 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:36.938733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d7dec167-3a34-47f7-93ea-a877b0e72203 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:36.940769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:36.941415 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=8 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:36.948332 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7dec167-3a34-47f7-93ea-a877b0e72203 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:36.948851 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7dec167-3a34-47f7-93ea-a877b0e72203 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:36.949812 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7dec167-3a34-47f7-93ea-a877b0e72203 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:36.950259 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7dec167-3a34-47f7-93ea-a877b0e72203 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:36.962978 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-8628b4d1-c750-4a55-8b12-1b3fc8b963c4 req-47a72927-7c47-48c3-b87b-26bff25dc9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83", "name": "network-vif-plugged", "status": "completed", "tag": "d1ad1964-f645-4ab1-ab1e-46f1e6771af4"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:36.967777 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=16 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:36.977719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-8628b4d1-c750-4a55-8b12-1b3fc8b963c4 req-47a72927-7c47-48c3-b87b-26bff25dc9c2 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:36.977719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-8628b4d1-c750-4a55-8b12-1b3fc8b963c4 req-47a72927-7c47-48c3-b87b-26bff25dc9c2 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:36.991631 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-8628b4d1-c750-4a55-8b12-1b3fc8b963c4 req-47a72927-7c47-48c3-b87b-26bff25dc9c2 service nova] Creating event network-vif-plugged:d1ad1964-f645-4ab1-ab1e-46f1e6771af4 for instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 on hv-cinder-83608 Jun 02 13:42:36.996695 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-8628b4d1-c750-4a55-8b12-1b3fc8b963c4 req-47a72927-7c47-48c3-b87b-26bff25dc9c2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037348 Jun 02 13:42:36.997489 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 429/878] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:42:37.002347 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-92c014a7-e43e-48b1-90c1-551dc589742d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:37.003036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-92c014a7-e43e-48b1-90c1-551dc589742d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:37.021984 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92c014a7-e43e-48b1-90c1-551dc589742d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:37.022438 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92c014a7-e43e-48b1-90c1-551dc589742d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:37.023416 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92c014a7-e43e-48b1-90c1-551dc589742d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:37.023861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92c014a7-e43e-48b1-90c1-551dc589742d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:37.134073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d7dec167-3a34-47f7-93ea-a877b0e72203 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:37.141643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d7dec167-3a34-47f7-93ea-a877b0e72203 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.208594 Jun 02 13:42:37.142220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 450/879] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:36 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:37.165250 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-76d09210-7c37-4044-aa48-b1da80bbe61d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:37.165866 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-76d09210-7c37-4044-aa48-b1da80bbe61d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:37.171764 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76d09210-7c37-4044-aa48-b1da80bbe61d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:37.172147 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76d09210-7c37-4044-aa48-b1da80bbe61d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:37.173066 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76d09210-7c37-4044-aa48-b1da80bbe61d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:37.173509 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76d09210-7c37-4044-aa48-b1da80bbe61d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:37.178556 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-92c014a7-e43e-48b1-90c1-551dc589742d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:37.186610 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-92c014a7-e43e-48b1-90c1-551dc589742d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:37.188114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-92c014a7-e43e-48b1-90c1-551dc589742d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:37.189305 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-92c014a7-e43e-48b1-90c1-551dc589742d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.190920 Jun 02 13:42:37.189866 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 430/880] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:36 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:37.300570 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-76d09210-7c37-4044-aa48-b1da80bbe61d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:37.307967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-76d09210-7c37-4044-aa48-b1da80bbe61d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1364 microversion: 2.1 time: 0.146465 Jun 02 13:42:37.308556 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 451/881] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:37 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:38.159674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3e381f11-a3f0-4ef7-bed6-86ca25046176 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:38.160319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3e381f11-a3f0-4ef7-bed6-86ca25046176 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:38.166642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3e381f11-a3f0-4ef7-bed6-86ca25046176 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:38.167090 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3e381f11-a3f0-4ef7-bed6-86ca25046176 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:38.167850 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3e381f11-a3f0-4ef7-bed6-86ca25046176 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:38.168279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3e381f11-a3f0-4ef7-bed6-86ca25046176 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:38.207606 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e2a75b09-25f4-42d2-abcf-8286689fa4ae tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:38.208264 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e2a75b09-25f4-42d2-abcf-8286689fa4ae tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:38.214699 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2a75b09-25f4-42d2-abcf-8286689fa4ae tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:38.215143 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2a75b09-25f4-42d2-abcf-8286689fa4ae tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:38.215903 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2a75b09-25f4-42d2-abcf-8286689fa4ae tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:38.216355 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2a75b09-25f4-42d2-abcf-8286689fa4ae tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:38.236415 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:38.397350 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3e381f11-a3f0-4ef7-bed6-86ca25046176 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:38.408854 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3e381f11-a3f0-4ef7-bed6-86ca25046176 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.253936 Jun 02 13:42:38.409511 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 431/882] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:38 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:38.421996 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b439a410-680c-45a2-94fc-cc24a33689ef tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:38.422613 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b439a410-680c-45a2-94fc-cc24a33689ef tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:38.430179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b439a410-680c-45a2-94fc-cc24a33689ef tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:38.430848 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b439a410-680c-45a2-94fc-cc24a33689ef tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:38.432175 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b439a410-680c-45a2-94fc-cc24a33689ef tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:38.432643 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b439a410-680c-45a2-94fc-cc24a33689ef tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:38.444673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e2a75b09-25f4-42d2-abcf-8286689fa4ae tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:38.458451 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e2a75b09-25f4-42d2-abcf-8286689fa4ae tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:38.459986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e2a75b09-25f4-42d2-abcf-8286689fa4ae tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:38.461266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e2a75b09-25f4-42d2-abcf-8286689fa4ae tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.258004 Jun 02 13:42:38.471983 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 452/883] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:38 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:42:38.583089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b439a410-680c-45a2-94fc-cc24a33689ef tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:38.590964 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b439a410-680c-45a2-94fc-cc24a33689ef tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1364 microversion: 2.1 time: 0.180297 Jun 02 13:42:38.591534 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 432/884] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:38 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:39.427429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ae8c3cb5-de38-47f2-a9de-c16bdf2e43fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:39.428840 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ae8c3cb5-de38-47f2-a9de-c16bdf2e43fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:39.437625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae8c3cb5-de38-47f2-a9de-c16bdf2e43fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.438364 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae8c3cb5-de38-47f2-a9de-c16bdf2e43fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.439142 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae8c3cb5-de38-47f2-a9de-c16bdf2e43fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.439744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae8c3cb5-de38-47f2-a9de-c16bdf2e43fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.480155 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0b7e4f08-a426-46a8-afd2-a305327a617f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:39.480943 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0b7e4f08-a426-46a8-afd2-a305327a617f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:39.488261 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b7e4f08-a426-46a8-afd2-a305327a617f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.488943 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b7e4f08-a426-46a8-afd2-a305327a617f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.489871 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b7e4f08-a426-46a8-afd2-a305327a617f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.490317 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b7e4f08-a426-46a8-afd2-a305327a617f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.625034 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ae8c3cb5-de38-47f2-a9de-c16bdf2e43fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:39.633649 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ae8c3cb5-de38-47f2-a9de-c16bdf2e43fd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1569 microversion: 2.1 time: 0.211037 Jun 02 13:42:39.634679 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 453/885] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:39 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:39.639555 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a7e7fed9-547e-4c25-b7c6-bad1f144a33a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:39.640385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a7e7fed9-547e-4c25-b7c6-bad1f144a33a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:39.646713 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a7e7fed9-547e-4c25-b7c6-bad1f144a33a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.647465 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a7e7fed9-547e-4c25-b7c6-bad1f144a33a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.648343 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a7e7fed9-547e-4c25-b7c6-bad1f144a33a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.648847 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a7e7fed9-547e-4c25-b7c6-bad1f144a33a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.666659 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0b7e4f08-a426-46a8-afd2-a305327a617f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:39.675832 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0b7e4f08-a426-46a8-afd2-a305327a617f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:39.677384 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0b7e4f08-a426-46a8-afd2-a305327a617f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:39.678569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0b7e4f08-a426-46a8-afd2-a305327a617f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.203498 Jun 02 13:42:39.679124 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 433/886] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:39 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:39.693793 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7b488789-550d-47c4-a3a6-6392fe26172b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:39.694542 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7b488789-550d-47c4-a3a6-6392fe26172b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:39.701363 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b488789-550d-47c4-a3a6-6392fe26172b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.701818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b488789-550d-47c4-a3a6-6392fe26172b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.702889 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b488789-550d-47c4-a3a6-6392fe26172b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.703495 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b488789-550d-47c4-a3a6-6392fe26172b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.787702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a7e7fed9-547e-4c25-b7c6-bad1f144a33a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:39.796007 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a7e7fed9-547e-4c25-b7c6-bad1f144a33a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1555 microversion: 2.1 time: 0.160070 Jun 02 13:42:39.796669 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 454/887] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:39 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:39.810342 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7b488789-550d-47c4-a3a6-6392fe26172b tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "POST /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61/action" status: 202 len: 0 microversion: 2.1 time: 0.129834 Jun 02 13:42:39.811692 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 434/888] 10.222.0.32 () {60 vars in 1277 bytes} [Thu Jun 2 13:42:39 2022] POST /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:42:39.816909 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d9d66110-e8d2-4f43-b84d-c6cfe5fffa0b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:39.817808 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d9d66110-e8d2-4f43-b84d-c6cfe5fffa0b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:39.820293 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-659d9f20-a703-40e9-b4a7-940a9960bf9d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:39.821041 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-659d9f20-a703-40e9-b4a7-940a9960bf9d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:39.824824 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d9d66110-e8d2-4f43-b84d-c6cfe5fffa0b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.825461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d9d66110-e8d2-4f43-b84d-c6cfe5fffa0b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.827167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d9d66110-e8d2-4f43-b84d-c6cfe5fffa0b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.828036 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d9d66110-e8d2-4f43-b84d-c6cfe5fffa0b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.828159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-659d9f20-a703-40e9-b4a7-940a9960bf9d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.828823 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-659d9f20-a703-40e9-b4a7-940a9960bf9d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.829739 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-659d9f20-a703-40e9-b4a7-940a9960bf9d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:39.830397 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-659d9f20-a703-40e9-b4a7-940a9960bf9d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:39.992526 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d9d66110-e8d2-4f43-b84d-c6cfe5fffa0b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183244 Jun 02 13:42:39.993263 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 455/889] 10.222.0.32 () {58 vars in 1274 bytes} [Thu Jun 2 13:42:39 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-interface => generated 285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:42:40.081494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-659d9f20-a703-40e9-b4a7-940a9960bf9d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:40.089240 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-659d9f20-a703-40e9-b4a7-940a9960bf9d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1577 microversion: 2.1 time: 0.273973 Jun 02 13:42:40.092370 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 435/890] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:39 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1577 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:40.698090 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-68716b49-4200-4b57-a464-6083db17fbf9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:40.698808 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-68716b49-4200-4b57-a464-6083db17fbf9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:40.706621 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-68716b49-4200-4b57-a464-6083db17fbf9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:40.707325 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-68716b49-4200-4b57-a464-6083db17fbf9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:40.708451 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-68716b49-4200-4b57-a464-6083db17fbf9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:40.709088 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-68716b49-4200-4b57-a464-6083db17fbf9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:40.884214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-68716b49-4200-4b57-a464-6083db17fbf9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:40.896544 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-68716b49-4200-4b57-a464-6083db17fbf9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:40.898266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-68716b49-4200-4b57-a464-6083db17fbf9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:40.899632 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-68716b49-4200-4b57-a464-6083db17fbf9 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1746 microversion: 2.20 time: 0.205914 Jun 02 13:42:40.910574 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 456/891] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:40 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1746 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:41.107442 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ebe2a8fb-0543-43d3-9d8a-ef326302aa40 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:41.108409 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ebe2a8fb-0543-43d3-9d8a-ef326302aa40 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:41.130251 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ebe2a8fb-0543-43d3-9d8a-ef326302aa40 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:41.131427 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ebe2a8fb-0543-43d3-9d8a-ef326302aa40 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:41.132868 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ebe2a8fb-0543-43d3-9d8a-ef326302aa40 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:41.133931 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ebe2a8fb-0543-43d3-9d8a-ef326302aa40 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:41.152858 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-53cc69c6-eddc-4a79-9fbd-c6685d30c3f1 req-7c9455a8-9fd5-4212-adf9-0d34cffbfc0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38561783-c8ae-4094-b4c9-419507739f61", "name": "network-vif-unplugged", "status": "completed", "tag": "f47de7fb-cfb6-4f5f-969c-a30939da7bf0"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:41.181613 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-53cc69c6-eddc-4a79-9fbd-c6685d30c3f1 req-7c9455a8-9fd5-4212-adf9-0d34cffbfc0c service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:41.182062 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-53cc69c6-eddc-4a79-9fbd-c6685d30c3f1 req-7c9455a8-9fd5-4212-adf9-0d34cffbfc0c service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:41.202119 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.compute.server_external_events [req-53cc69c6-eddc-4a79-9fbd-c6685d30c3f1 req-7c9455a8-9fd5-4212-adf9-0d34cffbfc0c service nova] Unable to find a host for instance 38561783-c8ae-4094-b4c9-419507739f61. Dropping event network-vif-unplugged {{(pid=124123) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 02 13:42:41.203267 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-53cc69c6-eddc-4a79-9fbd-c6685d30c3f1 req-7c9455a8-9fd5-4212-adf9-0d34cffbfc0c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056932 Jun 02 13:42:41.208782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 457/892] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 02 13:42:41.334801 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ebe2a8fb-0543-43d3-9d8a-ef326302aa40 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:41.345059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ebe2a8fb-0543-43d3-9d8a-ef326302aa40 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1519 microversion: 2.1 time: 0.241170 Jun 02 13:42:41.346009 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 436/893] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:41 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:41.399694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-0e1f7a23-5868-496f-9b1f-fb558d237b0a req-bf53ae8b-45df-4930-9cdc-402cecbe1194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83", "tag": "d1ad1964-f645-4ab1-ab1e-46f1e6771af4"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:41.409547 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-0e1f7a23-5868-496f-9b1f-fb558d237b0a req-bf53ae8b-45df-4930-9cdc-402cecbe1194 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:41.409992 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-0e1f7a23-5868-496f-9b1f-fb558d237b0a req-bf53ae8b-45df-4930-9cdc-402cecbe1194 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:41.420839 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-0e1f7a23-5868-496f-9b1f-fb558d237b0a req-bf53ae8b-45df-4930-9cdc-402cecbe1194 service nova] Creating event network-changed:d1ad1964-f645-4ab1-ab1e-46f1e6771af4 for instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 on hv-cinder-83608 Jun 02 13:42:41.426873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-0e1f7a23-5868-496f-9b1f-fb558d237b0a req-bf53ae8b-45df-4930-9cdc-402cecbe1194 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030945 Jun 02 13:42:41.427542 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 458/894] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:41.920139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dcacadfd-3197-45e8-89c2-5f24cdcbbcaf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:41.923551 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dcacadfd-3197-45e8-89c2-5f24cdcbbcaf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:41.938222 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcacadfd-3197-45e8-89c2-5f24cdcbbcaf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:41.938628 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcacadfd-3197-45e8-89c2-5f24cdcbbcaf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:41.939522 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcacadfd-3197-45e8-89c2-5f24cdcbbcaf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:41.939986 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcacadfd-3197-45e8-89c2-5f24cdcbbcaf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:42.119761 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dcacadfd-3197-45e8-89c2-5f24cdcbbcaf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:42.129352 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dcacadfd-3197-45e8-89c2-5f24cdcbbcaf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:42.131476 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dcacadfd-3197-45e8-89c2-5f24cdcbbcaf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:42.132789 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dcacadfd-3197-45e8-89c2-5f24cdcbbcaf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1746 microversion: 2.20 time: 0.218243 Jun 02 13:42:42.136344 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 437/895] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:41 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1746 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:42.364483 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-58883423-baee-4228-b28f-bf2a71572140 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:42.365130 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-58883423-baee-4228-b28f-bf2a71572140 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:42.376912 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58883423-baee-4228-b28f-bf2a71572140 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:42.377392 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58883423-baee-4228-b28f-bf2a71572140 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:42.378830 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58883423-baee-4228-b28f-bf2a71572140 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:42.379430 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58883423-baee-4228-b28f-bf2a71572140 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:42.543251 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-58883423-baee-4228-b28f-bf2a71572140 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:42.552040 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-58883423-baee-4228-b28f-bf2a71572140 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1519 microversion: 2.1 time: 0.192609 Jun 02 13:42:42.552735 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 459/896] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:42 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:43.150997 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0f65da5d-bc23-4bff-aae6-3e43a1b10a9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:43.151612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0f65da5d-bc23-4bff-aae6-3e43a1b10a9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:43.159907 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f65da5d-bc23-4bff-aae6-3e43a1b10a9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:43.160553 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f65da5d-bc23-4bff-aae6-3e43a1b10a9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:43.161429 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f65da5d-bc23-4bff-aae6-3e43a1b10a9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:43.162033 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f65da5d-bc23-4bff-aae6-3e43a1b10a9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:43.252963 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-eb037841-f6a9-4b4a-9e16-4e09bc9cf563 req-99331437-b525-4667-bb19-52b27c3252f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5608f7cb-9e96-4916-87e2-1f6efd94cae1", "name": "network-vif-plugged", "status": "completed", "tag": "081d1d87-4ea1-402c-a462-22f03273d76c"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:43.262307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-eb037841-f6a9-4b4a-9e16-4e09bc9cf563 req-99331437-b525-4667-bb19-52b27c3252f3 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:43.262920 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-eb037841-f6a9-4b4a-9e16-4e09bc9cf563 req-99331437-b525-4667-bb19-52b27c3252f3 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:43.278990 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-eb037841-f6a9-4b4a-9e16-4e09bc9cf563 req-99331437-b525-4667-bb19-52b27c3252f3 service nova] Creating event network-vif-plugged:081d1d87-4ea1-402c-a462-22f03273d76c for instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 on hv-cinder-83608 Jun 02 13:42:43.292149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-eb037841-f6a9-4b4a-9e16-4e09bc9cf563 req-99331437-b525-4667-bb19-52b27c3252f3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043164 Jun 02 13:42:43.293927 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 460/897] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:43.384914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0f65da5d-bc23-4bff-aae6-3e43a1b10a9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:43.394391 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0f65da5d-bc23-4bff-aae6-3e43a1b10a9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:43.396434 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0f65da5d-bc23-4bff-aae6-3e43a1b10a9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:43.397618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0f65da5d-bc23-4bff-aae6-3e43a1b10a9e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1741 microversion: 2.20 time: 0.250476 Jun 02 13:42:43.398171 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 438/898] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:43 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:43.574708 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d4d8cd0a-5553-4a4c-be03-dbb4b28a6248 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:43.583266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d4d8cd0a-5553-4a4c-be03-dbb4b28a6248 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:43.596994 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d4d8cd0a-5553-4a4c-be03-dbb4b28a6248 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:43.599917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d4d8cd0a-5553-4a4c-be03-dbb4b28a6248 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:43.604403 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d4d8cd0a-5553-4a4c-be03-dbb4b28a6248 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:43.605271 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d4d8cd0a-5553-4a4c-be03-dbb4b28a6248 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:43.889480 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d4d8cd0a-5553-4a4c-be03-dbb4b28a6248 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:43.900696 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d4d8cd0a-5553-4a4c-be03-dbb4b28a6248 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1575 microversion: 2.1 time: 0.331463 Jun 02 13:42:43.913562 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 461/899] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:43 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1575 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:44.417998 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-53343c5e-18d9-46d1-be9b-823ad3b8b46e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:44.419273 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-53343c5e-18d9-46d1-be9b-823ad3b8b46e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:44.427462 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53343c5e-18d9-46d1-be9b-823ad3b8b46e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:44.429718 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53343c5e-18d9-46d1-be9b-823ad3b8b46e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:44.430504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53343c5e-18d9-46d1-be9b-823ad3b8b46e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:44.430948 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53343c5e-18d9-46d1-be9b-823ad3b8b46e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:44.645757 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-53343c5e-18d9-46d1-be9b-823ad3b8b46e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:44.663153 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-53343c5e-18d9-46d1-be9b-823ad3b8b46e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:44.665108 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-53343c5e-18d9-46d1-be9b-823ad3b8b46e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:44.666594 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-53343c5e-18d9-46d1-be9b-823ad3b8b46e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1741 microversion: 2.20 time: 0.252584 Jun 02 13:42:44.667143 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 439/900] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:44 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1741 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:44.919163 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8257daf7-5f45-4559-8434-c6003e2dc41d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:44.921243 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8257daf7-5f45-4559-8434-c6003e2dc41d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:44.928010 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8257daf7-5f45-4559-8434-c6003e2dc41d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:44.928573 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8257daf7-5f45-4559-8434-c6003e2dc41d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:44.930726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8257daf7-5f45-4559-8434-c6003e2dc41d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:44.931959 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8257daf7-5f45-4559-8434-c6003e2dc41d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:45.141426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8257daf7-5f45-4559-8434-c6003e2dc41d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:45.150363 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8257daf7-5f45-4559-8434-c6003e2dc41d tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1575 microversion: 2.1 time: 0.235227 Jun 02 13:42:45.151282 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 462/901] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:44 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:45.686944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bf075285-3674-4f48-9787-c2b4f0cb04c7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:45.687687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bf075285-3674-4f48-9787-c2b4f0cb04c7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:45.694684 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf075285-3674-4f48-9787-c2b4f0cb04c7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:45.695537 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf075285-3674-4f48-9787-c2b4f0cb04c7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:45.696759 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf075285-3674-4f48-9787-c2b4f0cb04c7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:45.697395 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf075285-3674-4f48-9787-c2b4f0cb04c7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:46.134270 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bf075285-3674-4f48-9787-c2b4f0cb04c7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:46.143405 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bf075285-3674-4f48-9787-c2b4f0cb04c7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:46.144974 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bf075285-3674-4f48-9787-c2b4f0cb04c7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:46.146192 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bf075285-3674-4f48-9787-c2b4f0cb04c7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1741 microversion: 2.20 time: 0.464100 Jun 02 13:42:46.147100 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 440/902] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:45 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1741 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:46.167928 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0dca6dbf-b3d2-465e-ae2b-cdfa87c5d3bd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:46.169258 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0dca6dbf-b3d2-465e-ae2b-cdfa87c5d3bd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:46.178870 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0dca6dbf-b3d2-465e-ae2b-cdfa87c5d3bd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:46.179432 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0dca6dbf-b3d2-465e-ae2b-cdfa87c5d3bd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:46.184097 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0dca6dbf-b3d2-465e-ae2b-cdfa87c5d3bd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:46.184587 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0dca6dbf-b3d2-465e-ae2b-cdfa87c5d3bd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:46.328035 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0dca6dbf-b3d2-465e-ae2b-cdfa87c5d3bd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:46.336623 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0dca6dbf-b3d2-465e-ae2b-cdfa87c5d3bd tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1575 microversion: 2.1 time: 0.172527 Jun 02 13:42:46.340356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 463/903] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:46 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:47.165303 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-49bdbe17-0d40-45f9-b3a0-5105336e99b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:47.167160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-49bdbe17-0d40-45f9-b3a0-5105336e99b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:47.175586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49bdbe17-0d40-45f9-b3a0-5105336e99b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:47.176390 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49bdbe17-0d40-45f9-b3a0-5105336e99b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:47.177473 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49bdbe17-0d40-45f9-b3a0-5105336e99b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:47.194645 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49bdbe17-0d40-45f9-b3a0-5105336e99b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:47.351312 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-49bdbe17-0d40-45f9-b3a0-5105336e99b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:47.354709 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-061d673d-56ce-499c-9ff2-9af910e34590 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:47.355329 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-061d673d-56ce-499c-9ff2-9af910e34590 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:47.360977 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-49bdbe17-0d40-45f9-b3a0-5105336e99b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:47.362907 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-49bdbe17-0d40-45f9-b3a0-5105336e99b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:47.364634 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-49bdbe17-0d40-45f9-b3a0-5105336e99b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1741 microversion: 2.20 time: 0.203313 Jun 02 13:42:47.366041 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 441/904] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:47 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:42:47.370954 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-061d673d-56ce-499c-9ff2-9af910e34590 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:47.371405 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-061d673d-56ce-499c-9ff2-9af910e34590 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:47.372184 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-061d673d-56ce-499c-9ff2-9af910e34590 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:47.372645 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-061d673d-56ce-499c-9ff2-9af910e34590 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:47.549335 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-061d673d-56ce-499c-9ff2-9af910e34590 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:47.560313 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-061d673d-56ce-499c-9ff2-9af910e34590 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1575 microversion: 2.1 time: 0.209341 Jun 02 13:42:47.561784 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 464/905] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:47 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:48.386890 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b5d9862d-2ff8-471c-bb87-d71c7128a172 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:48.387986 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b5d9862d-2ff8-471c-bb87-d71c7128a172 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:48.395557 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5d9862d-2ff8-471c-bb87-d71c7128a172 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:48.398205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5d9862d-2ff8-471c-bb87-d71c7128a172 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:48.399586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5d9862d-2ff8-471c-bb87-d71c7128a172 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:48.400437 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5d9862d-2ff8-471c-bb87-d71c7128a172 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:48.580101 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fdb5ba53-8989-47ff-af6e-fbc420b95a8c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:48.581220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fdb5ba53-8989-47ff-af6e-fbc420b95a8c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:48.597433 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fdb5ba53-8989-47ff-af6e-fbc420b95a8c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:48.601124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fdb5ba53-8989-47ff-af6e-fbc420b95a8c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:48.602822 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fdb5ba53-8989-47ff-af6e-fbc420b95a8c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:48.603538 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fdb5ba53-8989-47ff-af6e-fbc420b95a8c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:48.625661 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b5d9862d-2ff8-471c-bb87-d71c7128a172 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:48.643425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b5d9862d-2ff8-471c-bb87-d71c7128a172 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:48.647667 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b5d9862d-2ff8-471c-bb87-d71c7128a172 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:48.649676 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b5d9862d-2ff8-471c-bb87-d71c7128a172 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1741 microversion: 2.20 time: 0.267876 Jun 02 13:42:48.651114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 442/906] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:48 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:48.824498 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fdb5ba53-8989-47ff-af6e-fbc420b95a8c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:48.838742 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fdb5ba53-8989-47ff-af6e-fbc420b95a8c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1575 microversion: 2.1 time: 0.263560 Jun 02 13:42:48.839335 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 465/907] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:48 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1575 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:49.669844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2d7da073-bfde-423c-8369-fb6170ae7390 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:49.670618 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2d7da073-bfde-423c-8369-fb6170ae7390 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:49.678121 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d7da073-bfde-423c-8369-fb6170ae7390 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:49.678936 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d7da073-bfde-423c-8369-fb6170ae7390 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:49.681352 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d7da073-bfde-423c-8369-fb6170ae7390 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:49.681352 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d7da073-bfde-423c-8369-fb6170ae7390 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:49.845502 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2d7da073-bfde-423c-8369-fb6170ae7390 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:49.856666 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bf12d6c1-3c61-409b-87fc-4166ee76256c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:49.857286 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bf12d6c1-3c61-409b-87fc-4166ee76256c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:49.860849 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:49.865596 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2d7da073-bfde-423c-8369-fb6170ae7390 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:49.867436 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2d7da073-bfde-423c-8369-fb6170ae7390 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:49.869216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2d7da073-bfde-423c-8369-fb6170ae7390 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1741 microversion: 2.20 time: 0.203178 Jun 02 13:42:49.872414 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bf12d6c1-3c61-409b-87fc-4166ee76256c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:49.872567 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 443/908] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:49 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:49.874428 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bf12d6c1-3c61-409b-87fc-4166ee76256c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:49.875484 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bf12d6c1-3c61-409b-87fc-4166ee76256c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:49.877310 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bf12d6c1-3c61-409b-87fc-4166ee76256c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:50.062800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bf12d6c1-3c61-409b-87fc-4166ee76256c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:50.072330 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bf12d6c1-3c61-409b-87fc-4166ee76256c tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1575 microversion: 2.1 time: 0.219722 Jun 02 13:42:50.073579 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 466/909] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:49 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:50.891234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3c5bf69f-a567-4825-9eae-4db4e53bc15f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:50.892633 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3c5bf69f-a567-4825-9eae-4db4e53bc15f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:50.902537 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c5bf69f-a567-4825-9eae-4db4e53bc15f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:50.903946 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c5bf69f-a567-4825-9eae-4db4e53bc15f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:50.905220 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c5bf69f-a567-4825-9eae-4db4e53bc15f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:50.905894 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c5bf69f-a567-4825-9eae-4db4e53bc15f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:51.060788 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3c5bf69f-a567-4825-9eae-4db4e53bc15f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:51.066343 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:51.078949 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3c5bf69f-a567-4825-9eae-4db4e53bc15f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:51.082596 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3c5bf69f-a567-4825-9eae-4db4e53bc15f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:51.091379 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b9863ea5-9dd2-4f90-81c8-95afde4ca45a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:51.092960 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b9863ea5-9dd2-4f90-81c8-95afde4ca45a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:51.094704 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3c5bf69f-a567-4825-9eae-4db4e53bc15f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1741 microversion: 2.20 time: 0.206295 Jun 02 13:42:51.095297 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 444/910] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:50 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:51.102355 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9863ea5-9dd2-4f90-81c8-95afde4ca45a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:51.103171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9863ea5-9dd2-4f90-81c8-95afde4ca45a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:51.104155 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9863ea5-9dd2-4f90-81c8-95afde4ca45a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:51.105042 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9863ea5-9dd2-4f90-81c8-95afde4ca45a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:51.258264 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b9863ea5-9dd2-4f90-81c8-95afde4ca45a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:51.266183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b9863ea5-9dd2-4f90-81c8-95afde4ca45a tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1575 microversion: 2.1 time: 0.180482 Jun 02 13:42:51.266706 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 467/911] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:51 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:52.121578 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c56bc241-2240-4841-ba1d-b6d547cf79f6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:52.124877 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c56bc241-2240-4841-ba1d-b6d547cf79f6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:52.137899 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c56bc241-2240-4841-ba1d-b6d547cf79f6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:52.138972 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c56bc241-2240-4841-ba1d-b6d547cf79f6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:52.140644 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c56bc241-2240-4841-ba1d-b6d547cf79f6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:52.141786 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c56bc241-2240-4841-ba1d-b6d547cf79f6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:52.293597 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-662c1b28-29db-4021-bf63-db64bb550789 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:52.294240 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-662c1b28-29db-4021-bf63-db64bb550789 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:52.316881 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-662c1b28-29db-4021-bf63-db64bb550789 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:52.317347 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-662c1b28-29db-4021-bf63-db64bb550789 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:52.318155 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-662c1b28-29db-4021-bf63-db64bb550789 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:52.318604 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-662c1b28-29db-4021-bf63-db64bb550789 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:52.384328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c56bc241-2240-4841-ba1d-b6d547cf79f6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:52.410072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c56bc241-2240-4841-ba1d-b6d547cf79f6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:52.416536 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c56bc241-2240-4841-ba1d-b6d547cf79f6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:52.420947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c56bc241-2240-4841-ba1d-b6d547cf79f6 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1741 microversion: 2.20 time: 0.305334 Jun 02 13:42:52.438895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 445/912] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:52 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1741 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:42:52.503212 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-662c1b28-29db-4021-bf63-db64bb550789 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:52.514191 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-662c1b28-29db-4021-bf63-db64bb550789 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1575 microversion: 2.1 time: 0.234408 Jun 02 13:42:52.515234 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 468/913] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:52 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:53.025644 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-d20aaef0-0849-43f7-a7f4-bb5b8912bc47 req-32d0016b-e12b-44d6-96d0-a5454fc57da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38561783-c8ae-4094-b4c9-419507739f61", "name": "network-vif-plugged", "status": "completed", "tag": "f47de7fb-cfb6-4f5f-969c-a30939da7bf0"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:53.034896 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d20aaef0-0849-43f7-a7f4-bb5b8912bc47 req-32d0016b-e12b-44d6-96d0-a5454fc57da4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:53.035490 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d20aaef0-0849-43f7-a7f4-bb5b8912bc47 req-32d0016b-e12b-44d6-96d0-a5454fc57da4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:53.046777 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-d20aaef0-0849-43f7-a7f4-bb5b8912bc47 req-32d0016b-e12b-44d6-96d0-a5454fc57da4 service nova] Creating event network-vif-plugged:f47de7fb-cfb6-4f5f-969c-a30939da7bf0 for instance 38561783-c8ae-4094-b4c9-419507739f61 on hv-cinder-83608 Jun 02 13:42:53.051679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-d20aaef0-0849-43f7-a7f4-bb5b8912bc47 req-32d0016b-e12b-44d6-96d0-a5454fc57da4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029754 Jun 02 13:42:53.052260 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 446/914] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:53.443495 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b06f5de6-039e-4993-bce2-b52e4d913527 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:53.444249 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b06f5de6-039e-4993-bce2-b52e4d913527 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:53.450701 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b06f5de6-039e-4993-bce2-b52e4d913527 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:53.451155 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b06f5de6-039e-4993-bce2-b52e4d913527 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:53.451936 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b06f5de6-039e-4993-bce2-b52e4d913527 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:53.452655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b06f5de6-039e-4993-bce2-b52e4d913527 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:53.533302 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-227281b0-6bf8-4a8b-a3db-2d3b93d84252 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:53.534324 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-227281b0-6bf8-4a8b-a3db-2d3b93d84252 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:53.543654 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-227281b0-6bf8-4a8b-a3db-2d3b93d84252 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:53.544172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-227281b0-6bf8-4a8b-a3db-2d3b93d84252 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:53.545062 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-227281b0-6bf8-4a8b-a3db-2d3b93d84252 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:53.545564 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-227281b0-6bf8-4a8b-a3db-2d3b93d84252 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:53.671961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b06f5de6-039e-4993-bce2-b52e4d913527 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:53.683067 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b06f5de6-039e-4993-bce2-b52e4d913527 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:53.684609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b06f5de6-039e-4993-bce2-b52e4d913527 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:53.686762 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b06f5de6-039e-4993-bce2-b52e4d913527 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1723 microversion: 2.20 time: 0.247743 Jun 02 13:42:53.688180 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 469/915] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:53 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:53.818901 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-227281b0-6bf8-4a8b-a3db-2d3b93d84252 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:53.828634 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-227281b0-6bf8-4a8b-a3db-2d3b93d84252 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1575 microversion: 2.1 time: 0.300057 Jun 02 13:42:53.829564 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 447/916] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:53 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1575 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:42:54.707349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4a7b2774-410b-4dcf-b22b-a09ee5438bc4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:54.708000 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4a7b2774-410b-4dcf-b22b-a09ee5438bc4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:54.714844 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4a7b2774-410b-4dcf-b22b-a09ee5438bc4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:54.715103 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4a7b2774-410b-4dcf-b22b-a09ee5438bc4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:54.716025 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4a7b2774-410b-4dcf-b22b-a09ee5438bc4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:54.716510 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4a7b2774-410b-4dcf-b22b-a09ee5438bc4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:54.845668 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-04d66532-1382-4991-a6a7-ec5e6ad71262 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:54.853294 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-04d66532-1382-4991-a6a7-ec5e6ad71262 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:54.867024 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04d66532-1382-4991-a6a7-ec5e6ad71262 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:54.870306 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04d66532-1382-4991-a6a7-ec5e6ad71262 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:54.871448 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04d66532-1382-4991-a6a7-ec5e6ad71262 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:54.872006 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04d66532-1382-4991-a6a7-ec5e6ad71262 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:54.890041 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4a7b2774-410b-4dcf-b22b-a09ee5438bc4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:54.898696 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4a7b2774-410b-4dcf-b22b-a09ee5438bc4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:54.900598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4a7b2774-410b-4dcf-b22b-a09ee5438bc4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:54.901785 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4a7b2774-410b-4dcf-b22b-a09ee5438bc4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1723 microversion: 2.20 time: 0.199280 Jun 02 13:42:54.902498 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 470/917] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:54 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:55.019077 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-04d66532-1382-4991-a6a7-ec5e6ad71262 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:55.026976 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-04d66532-1382-4991-a6a7-ec5e6ad71262 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1575 microversion: 2.1 time: 0.185143 Jun 02 13:42:55.027528 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 448/918] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:54 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:55.920905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9f8b037b-1d59-4aae-8841-1392c492e58b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:55.921522 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9f8b037b-1d59-4aae-8841-1392c492e58b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:55.928667 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9f8b037b-1d59-4aae-8841-1392c492e58b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:55.929120 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9f8b037b-1d59-4aae-8841-1392c492e58b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:55.929890 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9f8b037b-1d59-4aae-8841-1392c492e58b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:55.930350 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9f8b037b-1d59-4aae-8841-1392c492e58b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:55.950744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:42:56.044614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-28b10625-1489-4c3b-9485-3bff7ef5f15f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:56.045290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-28b10625-1489-4c3b-9485-3bff7ef5f15f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:56.052672 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28b10625-1489-4c3b-9485-3bff7ef5f15f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:56.053126 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28b10625-1489-4c3b-9485-3bff7ef5f15f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:56.053901 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28b10625-1489-4c3b-9485-3bff7ef5f15f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:56.054345 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28b10625-1489-4c3b-9485-3bff7ef5f15f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:56.061970 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9f8b037b-1d59-4aae-8841-1392c492e58b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:56.070423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9f8b037b-1d59-4aae-8841-1392c492e58b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:56.072270 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9f8b037b-1d59-4aae-8841-1392c492e58b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:56.073463 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9f8b037b-1d59-4aae-8841-1392c492e58b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1723 microversion: 2.20 time: 0.156503 Jun 02 13:42:56.074028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 471/919] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:55 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:56.194826 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-28b10625-1489-4c3b-9485-3bff7ef5f15f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:56.202780 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-28b10625-1489-4c3b-9485-3bff7ef5f15f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1562 microversion: 2.1 time: 0.161819 Jun 02 13:42:56.203341 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 449/920] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:42:56 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:42:56.990312 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-8bc12c37-e478-4c42-94bd-20b3be456491 req-af834245-8b4e-4d2e-867f-b31d201e9a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5608f7cb-9e96-4916-87e2-1f6efd94cae1", "name": "network-vif-unplugged", "status": "completed", "tag": "081d1d87-4ea1-402c-a462-22f03273d76c"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:56.999569 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-8bc12c37-e478-4c42-94bd-20b3be456491 req-af834245-8b4e-4d2e-867f-b31d201e9a3d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:57.000017 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-8bc12c37-e478-4c42-94bd-20b3be456491 req-af834245-8b4e-4d2e-867f-b31d201e9a3d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:57.017207 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-8bc12c37-e478-4c42-94bd-20b3be456491 req-af834245-8b4e-4d2e-867f-b31d201e9a3d service nova] Creating event network-vif-unplugged:081d1d87-4ea1-402c-a462-22f03273d76c for instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 on hv-cinder-83608 Jun 02 13:42:57.022882 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-8bc12c37-e478-4c42-94bd-20b3be456491 req-af834245-8b4e-4d2e-867f-b31d201e9a3d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037004 Jun 02 13:42:57.023484 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 472/921] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:42:57.091723 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f931a7f5-5f0e-4bf1-8cf6-cbee80134b8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:57.092367 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f931a7f5-5f0e-4bf1-8cf6-cbee80134b8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:57.098845 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f931a7f5-5f0e-4bf1-8cf6-cbee80134b8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:57.099300 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f931a7f5-5f0e-4bf1-8cf6-cbee80134b8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:57.100062 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f931a7f5-5f0e-4bf1-8cf6-cbee80134b8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:57.100540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f931a7f5-5f0e-4bf1-8cf6-cbee80134b8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:57.226708 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f931a7f5-5f0e-4bf1-8cf6-cbee80134b8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:57.234617 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f931a7f5-5f0e-4bf1-8cf6-cbee80134b8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:57.236120 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f931a7f5-5f0e-4bf1-8cf6-cbee80134b8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:57.237334 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f931a7f5-5f0e-4bf1-8cf6-cbee80134b8b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1723 microversion: 2.20 time: 0.149488 Jun 02 13:42:57.237888 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 450/922] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:57 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:58.256167 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-59c58987-4e06-487b-bf1b-c648f8b51789 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:58.256929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-59c58987-4e06-487b-bf1b-c648f8b51789 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:58.263250 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-59c58987-4e06-487b-bf1b-c648f8b51789 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:58.263649 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-59c58987-4e06-487b-bf1b-c648f8b51789 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:58.264452 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-59c58987-4e06-487b-bf1b-c648f8b51789 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:58.264902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-59c58987-4e06-487b-bf1b-c648f8b51789 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:58.394798 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-59c58987-4e06-487b-bf1b-c648f8b51789 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:58.402744 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-59c58987-4e06-487b-bf1b-c648f8b51789 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:58.404255 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-59c58987-4e06-487b-bf1b-c648f8b51789 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:58.405438 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-59c58987-4e06-487b-bf1b-c648f8b51789 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1666 microversion: 2.20 time: 0.154273 Jun 02 13:42:58.406002 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 473/923] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:58 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:42:58.423588 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-448fd2ef-15dd-45a9-949f-8b4e32426bba tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f68fdc2f-c19b-4a73-bed3-ac0c96b51a75"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:58.424799 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-448fd2ef-15dd-45a9-949f-8b4e32426bba tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:58.431315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-448fd2ef-15dd-45a9-949f-8b4e32426bba tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:58.431769 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-448fd2ef-15dd-45a9-949f-8b4e32426bba tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:58.432559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-448fd2ef-15dd-45a9-949f-8b4e32426bba tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:58.432998 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-448fd2ef-15dd-45a9-949f-8b4e32426bba tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:58.714484 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-448fd2ef-15dd-45a9-949f-8b4e32426bba tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "POST /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294851 Jun 02 13:42:58.715070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 451/924] 10.222.0.32 () {62 vars in 1363 bytes} [Thu Jun 2 13:42:58 2022] POST /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 13:42:58.826746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-db070383-2d02-4a4f-9c35-9a37d219363b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:58.827252 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-db070383-2d02-4a4f-9c35-9a37d219363b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:58.834186 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-db070383-2d02-4a4f-9c35-9a37d219363b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:58.834642 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-db070383-2d02-4a4f-9c35-9a37d219363b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:58.835417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-db070383-2d02-4a4f-9c35-9a37d219363b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:58.835875 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-db070383-2d02-4a4f-9c35-9a37d219363b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:59.100955 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-db070383-2d02-4a4f-9c35-9a37d219363b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/os-volume_attachments/f68fdc2f-c19b-4a73-bed3-ac0c96b51a75" status: 202 len: 0 microversion: 2.20 time: 0.278080 Jun 02 13:42:59.101656 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 474/925] 10.222.0.32 () {60 vars in 1456 bytes} [Thu Jun 2 13:42:58 2022] DELETE /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/os-volume_attachments/f68fdc2f-c19b-4a73-bed3-ac0c96b51a75 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:42:59.159081 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-92cce733-eb16-418e-8f2c-af2c57eb3339 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:42:59.159655 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-92cce733-eb16-418e-8f2c-af2c57eb3339 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:59.166400 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92cce733-eb16-418e-8f2c-af2c57eb3339 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:59.166853 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92cce733-eb16-418e-8f2c-af2c57eb3339 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:59.167665 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92cce733-eb16-418e-8f2c-af2c57eb3339 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:59.168090 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92cce733-eb16-418e-8f2c-af2c57eb3339 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:59.242735 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-92cce733-eb16-418e-8f2c-af2c57eb3339 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "POST /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/action" status: 202 len: 0 microversion: 2.20 time: 0.087297 Jun 02 13:42:59.243336 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 452/926] 10.222.0.32 () {62 vars in 1318 bytes} [Thu Jun 2 13:42:59 2022] POST /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:42:59.251331 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-17778a7e-6094-4aa4-ae20-a4f377c95ff7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:42:59.251945 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-17778a7e-6094-4aa4-ae20-a4f377c95ff7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:42:59.259169 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17778a7e-6094-4aa4-ae20-a4f377c95ff7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:59.259664 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17778a7e-6094-4aa4-ae20-a4f377c95ff7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:59.260397 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17778a7e-6094-4aa4-ae20-a4f377c95ff7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:42:59.260833 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17778a7e-6094-4aa4-ae20-a4f377c95ff7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:42:59.423683 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-17778a7e-6094-4aa4-ae20-a4f377c95ff7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:59.432461 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-17778a7e-6094-4aa4-ae20-a4f377c95ff7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:59.434040 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-17778a7e-6094-4aa4-ae20-a4f377c95ff7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:42:59.435408 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-17778a7e-6094-4aa4-ae20-a4f377c95ff7 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1674 microversion: 2.20 time: 0.187973 Jun 02 13:42:59.435963 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 475/927] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:42:59 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:00.455238 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f554a5e4-0ee6-4f84-b29b-9940dc79c464 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:00.455911 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f554a5e4-0ee6-4f84-b29b-9940dc79c464 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:00.462249 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f554a5e4-0ee6-4f84-b29b-9940dc79c464 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:00.462985 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f554a5e4-0ee6-4f84-b29b-9940dc79c464 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:00.464096 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f554a5e4-0ee6-4f84-b29b-9940dc79c464 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:00.464730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f554a5e4-0ee6-4f84-b29b-9940dc79c464 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:00.680448 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f554a5e4-0ee6-4f84-b29b-9940dc79c464 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:00.689059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f554a5e4-0ee6-4f84-b29b-9940dc79c464 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:00.691384 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f554a5e4-0ee6-4f84-b29b-9940dc79c464 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:00.693244 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f554a5e4-0ee6-4f84-b29b-9940dc79c464 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.241711 Jun 02 13:43:00.694737 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 453/928] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:00 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:01.715921 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-36484879-4f06-46de-bd43-ae3917c41798 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:01.716587 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-36484879-4f06-46de-bd43-ae3917c41798 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:01.730780 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-36484879-4f06-46de-bd43-ae3917c41798 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:01.731352 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-36484879-4f06-46de-bd43-ae3917c41798 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:01.733146 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-36484879-4f06-46de-bd43-ae3917c41798 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:01.733839 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-36484879-4f06-46de-bd43-ae3917c41798 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:01.962101 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-36484879-4f06-46de-bd43-ae3917c41798 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:01.973005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-36484879-4f06-46de-bd43-ae3917c41798 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:01.974498 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-36484879-4f06-46de-bd43-ae3917c41798 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:01.975658 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-36484879-4f06-46de-bd43-ae3917c41798 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.265288 Jun 02 13:43:01.976204 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 476/929] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:01 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:02.994617 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f3a98a78-1633-4965-a450-8527370899e3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:02.995178 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f3a98a78-1633-4965-a450-8527370899e3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:02.997767 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=67 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:03.004963 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f3a98a78-1633-4965-a450-8527370899e3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:03.005641 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f3a98a78-1633-4965-a450-8527370899e3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:03.006584 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f3a98a78-1633-4965-a450-8527370899e3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:03.007323 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f3a98a78-1633-4965-a450-8527370899e3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:03.152487 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f3a98a78-1633-4965-a450-8527370899e3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:03.161663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f3a98a78-1633-4965-a450-8527370899e3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:03.163184 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f3a98a78-1633-4965-a450-8527370899e3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:03.164370 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f3a98a78-1633-4965-a450-8527370899e3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.173702 Jun 02 13:43:03.164934 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 454/930] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:02 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:04.184018 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-37b8ab95-ab08-48b9-808e-b2f679ce2d4e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:04.184819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-37b8ab95-ab08-48b9-808e-b2f679ce2d4e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:04.192433 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-37b8ab95-ab08-48b9-808e-b2f679ce2d4e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:04.192910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-37b8ab95-ab08-48b9-808e-b2f679ce2d4e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:04.193689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-37b8ab95-ab08-48b9-808e-b2f679ce2d4e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:04.194128 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-37b8ab95-ab08-48b9-808e-b2f679ce2d4e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:04.333749 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-37b8ab95-ab08-48b9-808e-b2f679ce2d4e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:04.343793 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-37b8ab95-ab08-48b9-808e-b2f679ce2d4e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:04.345502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-37b8ab95-ab08-48b9-808e-b2f679ce2d4e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:04.346888 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-37b8ab95-ab08-48b9-808e-b2f679ce2d4e tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.166827 Jun 02 13:43:04.347620 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 477/931] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:04 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:05.366310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1146994f-2354-4d70-afd2-8822bcf17096 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:05.366928 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1146994f-2354-4d70-afd2-8822bcf17096 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:05.374705 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1146994f-2354-4d70-afd2-8822bcf17096 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:05.375242 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1146994f-2354-4d70-afd2-8822bcf17096 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:05.376388 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1146994f-2354-4d70-afd2-8822bcf17096 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:05.376907 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1146994f-2354-4d70-afd2-8822bcf17096 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:05.526506 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1146994f-2354-4d70-afd2-8822bcf17096 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:05.545627 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1146994f-2354-4d70-afd2-8822bcf17096 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:05.547407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1146994f-2354-4d70-afd2-8822bcf17096 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:05.549028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1146994f-2354-4d70-afd2-8822bcf17096 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.186477 Jun 02 13:43:05.549964 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 455/932] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:05 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:06.569434 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9fbaa6f4-b65d-4df9-82a3-7825589bd239 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:06.570047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9fbaa6f4-b65d-4df9-82a3-7825589bd239 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:06.577477 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fbaa6f4-b65d-4df9-82a3-7825589bd239 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:06.577938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fbaa6f4-b65d-4df9-82a3-7825589bd239 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:06.578734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fbaa6f4-b65d-4df9-82a3-7825589bd239 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:06.579773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fbaa6f4-b65d-4df9-82a3-7825589bd239 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:06.737137 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fbaa6f4-b65d-4df9-82a3-7825589bd239 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:06.745383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fbaa6f4-b65d-4df9-82a3-7825589bd239 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:06.746978 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fbaa6f4-b65d-4df9-82a3-7825589bd239 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:06.748173 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9fbaa6f4-b65d-4df9-82a3-7825589bd239 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.182660 Jun 02 13:43:06.748969 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 478/933] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:06 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:07.766476 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bc464b95-3e9b-41b3-98c0-3ddba23591b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:07.767087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bc464b95-3e9b-41b3-98c0-3ddba23591b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:07.774797 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc464b95-3e9b-41b3-98c0-3ddba23591b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:07.775244 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc464b95-3e9b-41b3-98c0-3ddba23591b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:07.776019 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc464b95-3e9b-41b3-98c0-3ddba23591b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:07.776517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc464b95-3e9b-41b3-98c0-3ddba23591b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:07.920276 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bc464b95-3e9b-41b3-98c0-3ddba23591b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:07.928830 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bc464b95-3e9b-41b3-98c0-3ddba23591b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:07.930425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bc464b95-3e9b-41b3-98c0-3ddba23591b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:07.931690 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bc464b95-3e9b-41b3-98c0-3ddba23591b2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.169142 Jun 02 13:43:07.932893 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 456/934] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:07 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:08.953024 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9da7ad94-dafe-4fe3-837f-4767c1fe2d9f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:08.953614 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9da7ad94-dafe-4fe3-837f-4767c1fe2d9f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:08.960794 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9da7ad94-dafe-4fe3-837f-4767c1fe2d9f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:08.961256 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9da7ad94-dafe-4fe3-837f-4767c1fe2d9f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:08.962034 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9da7ad94-dafe-4fe3-837f-4767c1fe2d9f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:08.962480 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9da7ad94-dafe-4fe3-837f-4767c1fe2d9f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:09.113894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9da7ad94-dafe-4fe3-837f-4767c1fe2d9f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:09.122509 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9da7ad94-dafe-4fe3-837f-4767c1fe2d9f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:09.124036 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9da7ad94-dafe-4fe3-837f-4767c1fe2d9f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:09.125311 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9da7ad94-dafe-4fe3-837f-4767c1fe2d9f tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.176646 Jun 02 13:43:09.125876 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 479/935] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:08 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:10.145673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-67f64b85-09a5-4397-bf12-66c21390404c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:10.146310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-67f64b85-09a5-4397-bf12-66c21390404c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:10.152883 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67f64b85-09a5-4397-bf12-66c21390404c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:10.153340 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67f64b85-09a5-4397-bf12-66c21390404c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:10.154116 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67f64b85-09a5-4397-bf12-66c21390404c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:10.154551 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67f64b85-09a5-4397-bf12-66c21390404c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:10.288451 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67f64b85-09a5-4397-bf12-66c21390404c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:10.296669 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67f64b85-09a5-4397-bf12-66c21390404c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:10.298197 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67f64b85-09a5-4397-bf12-66c21390404c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:10.299366 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-67f64b85-09a5-4397-bf12-66c21390404c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.158250 Jun 02 13:43:10.299926 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 457/936] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:10 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:11.317790 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a31534f5-de41-415f-8d47-6275b403e91a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:11.318403 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a31534f5-de41-415f-8d47-6275b403e91a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:11.325625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a31534f5-de41-415f-8d47-6275b403e91a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:11.326084 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a31534f5-de41-415f-8d47-6275b403e91a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:11.326884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a31534f5-de41-415f-8d47-6275b403e91a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:11.327593 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a31534f5-de41-415f-8d47-6275b403e91a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:11.456355 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a31534f5-de41-415f-8d47-6275b403e91a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:11.464242 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a31534f5-de41-415f-8d47-6275b403e91a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:11.465772 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a31534f5-de41-415f-8d47-6275b403e91a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:11.466929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a31534f5-de41-415f-8d47-6275b403e91a tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.153030 Jun 02 13:43:11.467489 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 480/937] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:11 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:12.485587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-70751681-7114-4a65-9a44-4399ad18d9cf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:12.486175 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-70751681-7114-4a65-9a44-4399ad18d9cf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:12.492642 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70751681-7114-4a65-9a44-4399ad18d9cf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:12.493087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70751681-7114-4a65-9a44-4399ad18d9cf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:12.493841 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70751681-7114-4a65-9a44-4399ad18d9cf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:12.494273 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70751681-7114-4a65-9a44-4399ad18d9cf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:12.511675 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:12.628912 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70751681-7114-4a65-9a44-4399ad18d9cf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:12.636780 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70751681-7114-4a65-9a44-4399ad18d9cf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:12.638289 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70751681-7114-4a65-9a44-4399ad18d9cf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:12.639437 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-70751681-7114-4a65-9a44-4399ad18d9cf tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.157752 Jun 02 13:43:12.640043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 458/938] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:12 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:13.658303 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c45ce8b3-bee7-4caf-9906-9daed8c5a90d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:13.658850 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c45ce8b3-bee7-4caf-9906-9daed8c5a90d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:13.665868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c45ce8b3-bee7-4caf-9906-9daed8c5a90d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:13.666321 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c45ce8b3-bee7-4caf-9906-9daed8c5a90d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:13.667089 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c45ce8b3-bee7-4caf-9906-9daed8c5a90d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:13.667528 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c45ce8b3-bee7-4caf-9906-9daed8c5a90d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:13.796124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c45ce8b3-bee7-4caf-9906-9daed8c5a90d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:13.804945 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c45ce8b3-bee7-4caf-9906-9daed8c5a90d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:13.806440 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c45ce8b3-bee7-4caf-9906-9daed8c5a90d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:13.807586 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c45ce8b3-bee7-4caf-9906-9daed8c5a90d tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.153449 Jun 02 13:43:13.808133 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 481/939] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:13 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:14.825580 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-67dd702d-03d3-485e-933b-e8561aaee710 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:14.826193 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-67dd702d-03d3-485e-933b-e8561aaee710 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:14.832931 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67dd702d-03d3-485e-933b-e8561aaee710 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:14.833386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67dd702d-03d3-485e-933b-e8561aaee710 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:14.834149 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67dd702d-03d3-485e-933b-e8561aaee710 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:14.834594 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67dd702d-03d3-485e-933b-e8561aaee710 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:14.966097 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67dd702d-03d3-485e-933b-e8561aaee710 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:14.975171 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67dd702d-03d3-485e-933b-e8561aaee710 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:14.976710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67dd702d-03d3-485e-933b-e8561aaee710 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:14.977871 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-67dd702d-03d3-485e-933b-e8561aaee710 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.156167 Jun 02 13:43:14.978428 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 459/940] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:14 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:15.996953 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e77381d7-7cd0-4732-a7b3-6411db55bc9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:15.997489 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e77381d7-7cd0-4732-a7b3-6411db55bc9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:16.003926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e77381d7-7cd0-4732-a7b3-6411db55bc9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:16.004440 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e77381d7-7cd0-4732-a7b3-6411db55bc9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:16.005244 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e77381d7-7cd0-4732-a7b3-6411db55bc9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:16.005685 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e77381d7-7cd0-4732-a7b3-6411db55bc9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:16.137457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e77381d7-7cd0-4732-a7b3-6411db55bc9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:16.145393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e77381d7-7cd0-4732-a7b3-6411db55bc9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:16.147431 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e77381d7-7cd0-4732-a7b3-6411db55bc9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:16.148611 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e77381d7-7cd0-4732-a7b3-6411db55bc9c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.155699 Jun 02 13:43:16.149183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 482/941] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:15 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:17.168173 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-627aa8ab-5cac-4925-a109-3ad69e374ac2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:17.169476 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-627aa8ab-5cac-4925-a109-3ad69e374ac2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:17.178985 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-627aa8ab-5cac-4925-a109-3ad69e374ac2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:17.179654 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-627aa8ab-5cac-4925-a109-3ad69e374ac2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:17.180860 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-627aa8ab-5cac-4925-a109-3ad69e374ac2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:17.181305 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-627aa8ab-5cac-4925-a109-3ad69e374ac2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:17.186596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-c9ffbbfe-7c9d-4de4-b4aa-f835202a1a4b req-e1e95894-8200-42c8-a344-705eb7e8b4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5608f7cb-9e96-4916-87e2-1f6efd94cae1", "name": "network-vif-plugged", "status": "completed", "tag": "081d1d87-4ea1-402c-a462-22f03273d76c"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:43:17.203530 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-c9ffbbfe-7c9d-4de4-b4aa-f835202a1a4b req-e1e95894-8200-42c8-a344-705eb7e8b4e5 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:17.203981 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-c9ffbbfe-7c9d-4de4-b4aa-f835202a1a4b req-e1e95894-8200-42c8-a344-705eb7e8b4e5 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:17.235857 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-c9ffbbfe-7c9d-4de4-b4aa-f835202a1a4b req-e1e95894-8200-42c8-a344-705eb7e8b4e5 service nova] Creating event network-vif-plugged:081d1d87-4ea1-402c-a462-22f03273d76c for instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 on hv-cinder-83608 Jun 02 13:43:17.241983 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-c9ffbbfe-7c9d-4de4-b4aa-f835202a1a4b req-e1e95894-8200-42c8-a344-705eb7e8b4e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059685 Jun 02 13:43:17.242595 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 483/942] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:43:17.315809 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-627aa8ab-5cac-4925-a109-3ad69e374ac2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:17.323806 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-627aa8ab-5cac-4925-a109-3ad69e374ac2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:17.325386 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-627aa8ab-5cac-4925-a109-3ad69e374ac2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:17.326533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-627aa8ab-5cac-4925-a109-3ad69e374ac2 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.162868 Jun 02 13:43:17.327083 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 460/943] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:17 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:18.345396 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9fe24c8b-ba3f-4be7-99f4-6d89b9d178dc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:18.346140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9fe24c8b-ba3f-4be7-99f4-6d89b9d178dc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:18.352650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fe24c8b-ba3f-4be7-99f4-6d89b9d178dc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:18.353096 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fe24c8b-ba3f-4be7-99f4-6d89b9d178dc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:18.353879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fe24c8b-ba3f-4be7-99f4-6d89b9d178dc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:18.354318 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fe24c8b-ba3f-4be7-99f4-6d89b9d178dc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:18.479856 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fe24c8b-ba3f-4be7-99f4-6d89b9d178dc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:18.487714 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fe24c8b-ba3f-4be7-99f4-6d89b9d178dc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:18.489238 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fe24c8b-ba3f-4be7-99f4-6d89b9d178dc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:18.490900 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9fe24c8b-ba3f-4be7-99f4-6d89b9d178dc tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.149734 Jun 02 13:43:18.491455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 484/944] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:18 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:19.509365 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-67f75eb3-b2d6-4541-93ce-5099cff537d5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:19.509969 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-67f75eb3-b2d6-4541-93ce-5099cff537d5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:19.516552 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67f75eb3-b2d6-4541-93ce-5099cff537d5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:19.517000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67f75eb3-b2d6-4541-93ce-5099cff537d5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:19.517755 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67f75eb3-b2d6-4541-93ce-5099cff537d5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:19.518194 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67f75eb3-b2d6-4541-93ce-5099cff537d5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:19.651469 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67f75eb3-b2d6-4541-93ce-5099cff537d5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:19.659336 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67f75eb3-b2d6-4541-93ce-5099cff537d5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:19.660858 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67f75eb3-b2d6-4541-93ce-5099cff537d5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:19.662050 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-67f75eb3-b2d6-4541-93ce-5099cff537d5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.157132 Jun 02 13:43:19.662603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 461/945] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:19 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:20.680449 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e8dd60d5-217f-4bd2-892a-9f91ed3f1b41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:20.681065 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e8dd60d5-217f-4bd2-892a-9f91ed3f1b41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:20.683583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=37 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:20.689150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e8dd60d5-217f-4bd2-892a-9f91ed3f1b41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:20.689822 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e8dd60d5-217f-4bd2-892a-9f91ed3f1b41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:20.690594 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e8dd60d5-217f-4bd2-892a-9f91ed3f1b41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:20.691035 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e8dd60d5-217f-4bd2-892a-9f91ed3f1b41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:20.827474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e8dd60d5-217f-4bd2-892a-9f91ed3f1b41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:20.835691 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e8dd60d5-217f-4bd2-892a-9f91ed3f1b41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:20.837265 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e8dd60d5-217f-4bd2-892a-9f91ed3f1b41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:20.838385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e8dd60d5-217f-4bd2-892a-9f91ed3f1b41 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1732 microversion: 2.20 time: 0.161822 Jun 02 13:43:20.838950 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 485/946] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:20 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:21.856623 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b9a1bdc1-360f-46e0-a5b8-0cb61886e4e4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:21.858326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b9a1bdc1-360f-46e0-a5b8-0cb61886e4e4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:21.865136 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9a1bdc1-360f-46e0-a5b8-0cb61886e4e4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:21.865588 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9a1bdc1-360f-46e0-a5b8-0cb61886e4e4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:21.866540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9a1bdc1-360f-46e0-a5b8-0cb61886e4e4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:21.867118 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9a1bdc1-360f-46e0-a5b8-0cb61886e4e4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:22.016559 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b9a1bdc1-360f-46e0-a5b8-0cb61886e4e4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:22.026256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b9a1bdc1-360f-46e0-a5b8-0cb61886e4e4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:22.027806 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b9a1bdc1-360f-46e0-a5b8-0cb61886e4e4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:22.029049 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b9a1bdc1-360f-46e0-a5b8-0cb61886e4e4 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1719 microversion: 2.20 time: 0.176373 Jun 02 13:43:22.035664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 462/947] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:43:21 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:43:26.432865 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-456453325", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "networks": [{"uuid": "10c1d284-3a29-4b9e-ab99-28b1ea991f3e"}]}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:43:26.483669 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] validate_networks() for [('10c1d284-3a29-4b9e-ab99-28b1ea991f3e', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:43:26.823328 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:43:26.823753 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:43:26.824233 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:43:26.824686 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:43:26.825101 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:43:26.834870 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:26.835316 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:26.836120 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:26.836595 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:26.843156 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:26.855701 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Getting quotas for project aa0c8692daa04252a385888208812cf4. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:43:26.859613 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Getting quotas for user 4c181d9000214ce78c5acb11ac6f6f7e and project aa0c8692daa04252a385888208812cf4. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:43:26.871128 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:43:26.873389 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:43:26.917591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c688e6a8-2363-44d9-91c5-9971a8c24cee tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488530 Jun 02 13:43:26.918232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 486/948] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:43:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:43:26.928822 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a3ac457b-de9d-45b6-9356-0e3c33215a0e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:26.929582 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a3ac457b-de9d-45b6-9356-0e3c33215a0e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:26.984542 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a3ac457b-de9d-45b6-9356-0e3c33215a0e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:26.992073 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a3ac457b-de9d-45b6-9356-0e3c33215a0e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1218 microversion: 2.1 time: 0.067752 Jun 02 13:43:26.993107 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 463/949] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:26 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:28.009278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c70a82d0-046b-454f-a134-bfbb0bd26935 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:28.010090 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c70a82d0-046b-454f-a134-bfbb0bd26935 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:28.017501 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c70a82d0-046b-454f-a134-bfbb0bd26935 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:28.017965 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c70a82d0-046b-454f-a134-bfbb0bd26935 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:28.018745 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c70a82d0-046b-454f-a134-bfbb0bd26935 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:28.019189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c70a82d0-046b-454f-a134-bfbb0bd26935 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:28.362496 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c70a82d0-046b-454f-a134-bfbb0bd26935 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:28.370528 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c70a82d0-046b-454f-a134-bfbb0bd26935 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1278 microversion: 2.1 time: 0.365986 Jun 02 13:43:28.377598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 487/950] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:28 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1278 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:29.341101 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-eeabe008-ed5c-4460-84db-5bd78a20ee0c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:29.341594 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-eeabe008-ed5c-4460-84db-5bd78a20ee0c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:29.348705 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eeabe008-ed5c-4460-84db-5bd78a20ee0c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:29.349172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eeabe008-ed5c-4460-84db-5bd78a20ee0c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:29.350436 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eeabe008-ed5c-4460-84db-5bd78a20ee0c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:29.350873 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eeabe008-ed5c-4460-84db-5bd78a20ee0c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:29.375195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-eeabe008-ed5c-4460-84db-5bd78a20ee0c tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/ips" status: 200 len: 146 microversion: 2.1 time: 0.038296 Jun 02 13:43:29.375780 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 464/951] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Jun 2 13:43:29 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:29.387537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c562a8f7-29f6-49f8-b5ab-aaa5cf6533e5 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:29.388188 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c562a8f7-29f6-49f8-b5ab-aaa5cf6533e5 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:29.397688 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c562a8f7-29f6-49f8-b5ab-aaa5cf6533e5 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:29.398827 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c562a8f7-29f6-49f8-b5ab-aaa5cf6533e5 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:29.399364 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c562a8f7-29f6-49f8-b5ab-aaa5cf6533e5 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:29.399868 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c562a8f7-29f6-49f8-b5ab-aaa5cf6533e5 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:29.595299 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c562a8f7-29f6-49f8-b5ab-aaa5cf6533e5 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:29.612669 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c562a8f7-29f6-49f8-b5ab-aaa5cf6533e5 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1318 microversion: 2.1 time: 0.229125 Jun 02 13:43:29.613601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 488/952] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:29 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:43:29.717093 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-f4b8edd1-35db-4d3d-afdb-b824a50ab235 req-9db81bad-441b-4b88-9311-176d65181516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54", "tag": "2bc0cf5d-c91d-4aaa-8888-ed605087b6d7"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:43:29.726240 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-f4b8edd1-35db-4d3d-afdb-b824a50ab235 req-9db81bad-441b-4b88-9311-176d65181516 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:29.726687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-f4b8edd1-35db-4d3d-afdb-b824a50ab235 req-9db81bad-441b-4b88-9311-176d65181516 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:29.738061 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-f4b8edd1-35db-4d3d-afdb-b824a50ab235 req-9db81bad-441b-4b88-9311-176d65181516 service nova] Creating event network-changed:2bc0cf5d-c91d-4aaa-8888-ed605087b6d7 for instance fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 on hv-cinder-83608 Jun 02 13:43:29.743697 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-f4b8edd1-35db-4d3d-afdb-b824a50ab235 req-9db81bad-441b-4b88-9311-176d65181516 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029913 Jun 02 13:43:29.744075 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 465/953] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:30.631374 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-627c400c-48b5-431c-971b-12b499668567 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:30.632018 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-627c400c-48b5-431c-971b-12b499668567 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:30.638469 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-627c400c-48b5-431c-971b-12b499668567 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:30.638912 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-627c400c-48b5-431c-971b-12b499668567 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:30.639667 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-627c400c-48b5-431c-971b-12b499668567 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:30.640101 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-627c400c-48b5-431c-971b-12b499668567 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:30.726707 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5d9672b9-46e5-4bd2-b534-2a2ee88e67f7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a2c2833-7c36-4f98-93e2-f6c22f6e8827"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:43:30.727877 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5d9672b9-46e5-4bd2-b534-2a2ee88e67f7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:30.734287 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d9672b9-46e5-4bd2-b534-2a2ee88e67f7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:30.734735 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d9672b9-46e5-4bd2-b534-2a2ee88e67f7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:30.735512 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d9672b9-46e5-4bd2-b534-2a2ee88e67f7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:30.735955 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d9672b9-46e5-4bd2-b534-2a2ee88e67f7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:30.779588 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-627c400c-48b5-431c-971b-12b499668567 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:30.787553 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-627c400c-48b5-431c-971b-12b499668567 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1318 microversion: 2.1 time: 0.159682 Jun 02 13:43:30.788122 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 489/954] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:30 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:31.448938 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5d9672b9-46e5-4bd2-b534-2a2ee88e67f7 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.727328 Jun 02 13:43:31.449542 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 466/955] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:43:30 2022] POST /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:43:31.804665 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f69626ff-95f6-4050-a021-af253d5a2aeb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:31.805266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f69626ff-95f6-4050-a021-af253d5a2aeb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:31.811648 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f69626ff-95f6-4050-a021-af253d5a2aeb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:31.812041 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f69626ff-95f6-4050-a021-af253d5a2aeb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:31.812835 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f69626ff-95f6-4050-a021-af253d5a2aeb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:31.813266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f69626ff-95f6-4050-a021-af253d5a2aeb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:31.943728 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f69626ff-95f6-4050-a021-af253d5a2aeb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:31.952540 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f69626ff-95f6-4050-a021-af253d5a2aeb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1318 microversion: 2.1 time: 0.152019 Jun 02 13:43:31.953113 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 490/956] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:31 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:32.971042 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9d4ba038-0835-457d-8210-d1ff0b61de7f tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:32.971751 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9d4ba038-0835-457d-8210-d1ff0b61de7f tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:32.978770 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9d4ba038-0835-457d-8210-d1ff0b61de7f tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:32.979228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9d4ba038-0835-457d-8210-d1ff0b61de7f tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:32.979993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9d4ba038-0835-457d-8210-d1ff0b61de7f tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:32.980471 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9d4ba038-0835-457d-8210-d1ff0b61de7f tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:33.106383 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9d4ba038-0835-457d-8210-d1ff0b61de7f tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:33.113759 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9d4ba038-0835-457d-8210-d1ff0b61de7f tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1318 microversion: 2.1 time: 0.147871 Jun 02 13:43:33.114318 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 467/957] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:32 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:34.130892 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6495ad40-15df-4502-8416-c616fe407f0d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:34.132127 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6495ad40-15df-4502-8416-c616fe407f0d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:34.138635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6495ad40-15df-4502-8416-c616fe407f0d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:34.139086 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6495ad40-15df-4502-8416-c616fe407f0d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:34.139853 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6495ad40-15df-4502-8416-c616fe407f0d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:34.140291 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6495ad40-15df-4502-8416-c616fe407f0d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:34.265022 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6495ad40-15df-4502-8416-c616fe407f0d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:34.272373 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6495ad40-15df-4502-8416-c616fe407f0d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1318 microversion: 2.1 time: 0.145390 Jun 02 13:43:34.272945 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 491/958] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:34 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:35.281872 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-c454ff7b-0444-419b-aedb-debffcfee56d req-9e721dc2-b675-4353-8307-2f9b373d7a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54", "name": "network-vif-plugged", "status": "completed", "tag": "2bc0cf5d-c91d-4aaa-8888-ed605087b6d7"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:43:35.288385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fc7c15bf-23ff-49fb-8ea0-1c0b83f059ea tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:35.288991 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=30 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:35.289547 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fc7c15bf-23ff-49fb-8ea0-1c0b83f059ea tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:35.292234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-c454ff7b-0444-419b-aedb-debffcfee56d req-9e721dc2-b675-4353-8307-2f9b373d7a13 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:35.293326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-c454ff7b-0444-419b-aedb-debffcfee56d req-9e721dc2-b675-4353-8307-2f9b373d7a13 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:35.296582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc7c15bf-23ff-49fb-8ea0-1c0b83f059ea tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:35.297241 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc7c15bf-23ff-49fb-8ea0-1c0b83f059ea tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:35.298184 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc7c15bf-23ff-49fb-8ea0-1c0b83f059ea tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:35.298617 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc7c15bf-23ff-49fb-8ea0-1c0b83f059ea tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:35.307845 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-c454ff7b-0444-419b-aedb-debffcfee56d req-9e721dc2-b675-4353-8307-2f9b373d7a13 service nova] Creating event network-vif-plugged:2bc0cf5d-c91d-4aaa-8888-ed605087b6d7 for instance fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 on hv-cinder-83608 Jun 02 13:43:35.313046 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-c454ff7b-0444-419b-aedb-debffcfee56d req-9e721dc2-b675-4353-8307-2f9b373d7a13 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034796 Jun 02 13:43:35.313822 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 468/959] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:35.434781 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fc7c15bf-23ff-49fb-8ea0-1c0b83f059ea tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:35.444722 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fc7c15bf-23ff-49fb-8ea0-1c0b83f059ea tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1318 microversion: 2.1 time: 0.159670 Jun 02 13:43:35.445343 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 492/960] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:35 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:43:36.464472 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fcaeb8ac-1a56-40af-b70a-d8fbf781e088 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:36.465171 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fcaeb8ac-1a56-40af-b70a-d8fbf781e088 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:36.471305 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fcaeb8ac-1a56-40af-b70a-d8fbf781e088 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:36.471746 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fcaeb8ac-1a56-40af-b70a-d8fbf781e088 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:36.472540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fcaeb8ac-1a56-40af-b70a-d8fbf781e088 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:36.472976 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fcaeb8ac-1a56-40af-b70a-d8fbf781e088 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:36.602552 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fcaeb8ac-1a56-40af-b70a-d8fbf781e088 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:36.610089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fcaeb8ac-1a56-40af-b70a-d8fbf781e088 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1318 microversion: 2.1 time: 0.150766 Jun 02 13:43:36.610643 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 469/961] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:36 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:36.675084 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e08e1d9e-6557-4881-aa7b-b7be6576cfd8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:36.675607 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e08e1d9e-6557-4881-aa7b-b7be6576cfd8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:36.682203 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e08e1d9e-6557-4881-aa7b-b7be6576cfd8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:36.682656 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e08e1d9e-6557-4881-aa7b-b7be6576cfd8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:36.683416 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e08e1d9e-6557-4881-aa7b-b7be6576cfd8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:36.683888 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e08e1d9e-6557-4881-aa7b-b7be6576cfd8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:36.706712 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e08e1d9e-6557-4881-aa7b-b7be6576cfd8 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/ips" status: 200 len: 150 microversion: 2.1 time: 0.035438 Jun 02 13:43:36.707266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 493/962] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Jun 2 13:43:36 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:37.626553 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-91a71eae-486d-4ee0-83d3-a27922164b6a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:37.627245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-91a71eae-486d-4ee0-83d3-a27922164b6a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:37.629221 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:37.635310 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-91a71eae-486d-4ee0-83d3-a27922164b6a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:37.635759 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-91a71eae-486d-4ee0-83d3-a27922164b6a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:37.636582 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-91a71eae-486d-4ee0-83d3-a27922164b6a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:37.637024 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-91a71eae-486d-4ee0-83d3-a27922164b6a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:37.782501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-91a71eae-486d-4ee0-83d3-a27922164b6a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:37.790602 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-91a71eae-486d-4ee0-83d3-a27922164b6a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1508 microversion: 2.1 time: 0.167967 Jun 02 13:43:37.791159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 470/963] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:37 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:38.024508 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b9a66887-4054-449a-bd73-0dc67f15cfc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e495af4f-7909-4cc8-8ccb-384e0bb2decc"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:43:38.025627 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b9a66887-4054-449a-bd73-0dc67f15cfc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:38.027452 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:38.028280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=6 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:38.034412 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9a66887-4054-449a-bd73-0dc67f15cfc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:38.034860 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9a66887-4054-449a-bd73-0dc67f15cfc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:38.035625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9a66887-4054-449a-bd73-0dc67f15cfc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:38.036062 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9a66887-4054-449a-bd73-0dc67f15cfc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:38.758904 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b9a66887-4054-449a-bd73-0dc67f15cfc5 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "POST /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738683 Jun 02 13:43:38.759495 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 494/964] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:43:38 2022] POST /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments => generated 194 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:38.934021 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c3579f44-6943-41ee-829a-b068619d5372 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:38.934743 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c3579f44-6943-41ee-829a-b068619d5372 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:38.941390 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3579f44-6943-41ee-829a-b068619d5372 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:38.941843 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3579f44-6943-41ee-829a-b068619d5372 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:38.942602 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3579f44-6943-41ee-829a-b068619d5372 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:38.943063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3579f44-6943-41ee-829a-b068619d5372 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:38.972204 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c3579f44-6943-41ee-829a-b068619d5372 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042292 Jun 02 13:43:38.972898 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 471/965] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:38 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:38.984235 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bcc70407-b418-49e8-8b1d-494d7f111397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:38.984884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bcc70407-b418-49e8-8b1d-494d7f111397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:38.991780 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bcc70407-b418-49e8-8b1d-494d7f111397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:38.992234 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bcc70407-b418-49e8-8b1d-494d7f111397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:38.993065 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bcc70407-b418-49e8-8b1d-494d7f111397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:38.993511 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bcc70407-b418-49e8-8b1d-494d7f111397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:39.024752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bcc70407-b418-49e8-8b1d-494d7f111397 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments/5a2c2833-7c36-4f98-93e2-f6c22f6e8827" status: 200 len: 194 microversion: 2.1 time: 0.045203 Jun 02 13:43:39.026145 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 495/966] 10.222.0.32 () {58 vars in 1412 bytes} [Thu Jun 2 13:43:38 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments/5a2c2833-7c36-4f98-93e2-f6c22f6e8827 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:40.357555 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d94c3b9a-1995-445d-b669-da9da2a9d8f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e09571d-a003-4ca1-bc0e-7eb24a061120"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:43:40.358612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d94c3b9a-1995-445d-b669-da9da2a9d8f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:40.365332 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d94c3b9a-1995-445d-b669-da9da2a9d8f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:40.366445 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d94c3b9a-1995-445d-b669-da9da2a9d8f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:40.367218 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d94c3b9a-1995-445d-b669-da9da2a9d8f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:40.367660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d94c3b9a-1995-445d-b669-da9da2a9d8f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:40.639839 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d94c3b9a-1995-445d-b669-da9da2a9d8f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "POST /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286048 Jun 02 13:43:40.640664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 472/967] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:43:40 2022] POST /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:46.339885 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-35c34889-bcd3-4b35-a751-c8586ce58452 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:46.340438 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-35c34889-bcd3-4b35-a751-c8586ce58452 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:46.346980 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-35c34889-bcd3-4b35-a751-c8586ce58452 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:46.347437 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-35c34889-bcd3-4b35-a751-c8586ce58452 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:46.348206 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-35c34889-bcd3-4b35-a751-c8586ce58452 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:46.348676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-35c34889-bcd3-4b35-a751-c8586ce58452 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:46.429850 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-35c34889-bcd3-4b35-a751-c8586ce58452 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lazy-loading 'services' on Instance uuid 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:43:46.499915 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-35c34889-bcd3-4b35-a751-c8586ce58452 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments/e495af4f-7909-4cc8-8ccb-384e0bb2decc" status: 202 len: 0 microversion: 2.1 time: 0.163793 Jun 02 13:43:46.500624 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 496/968] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:43:46 2022] DELETE /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments/e495af4f-7909-4cc8-8ccb-384e0bb2decc => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:43:46.509539 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-304c9cc0-2bfd-414b-a2a4-fb20e7d03f7c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:46.510612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-304c9cc0-2bfd-414b-a2a4-fb20e7d03f7c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:46.517869 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-304c9cc0-2bfd-414b-a2a4-fb20e7d03f7c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:46.518321 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-304c9cc0-2bfd-414b-a2a4-fb20e7d03f7c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:46.519119 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-304c9cc0-2bfd-414b-a2a4-fb20e7d03f7c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:46.519543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-304c9cc0-2bfd-414b-a2a4-fb20e7d03f7c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:46.523370 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:46.551857 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-304c9cc0-2bfd-414b-a2a4-fb20e7d03f7c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046568 Jun 02 13:43:46.552435 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 473/969] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:46 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:47.564626 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4f633499-d255-43a6-bca2-640855bc97cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:47.565688 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4f633499-d255-43a6-bca2-640855bc97cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:47.571970 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f633499-d255-43a6-bca2-640855bc97cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:47.572456 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f633499-d255-43a6-bca2-640855bc97cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:47.573219 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f633499-d255-43a6-bca2-640855bc97cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:47.573656 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f633499-d255-43a6-bca2-640855bc97cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:47.604028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4f633499-d255-43a6-bca2-640855bc97cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Jun 02 13:43:47.604598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 497/970] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:47 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:48.615568 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dc9bea2b-4709-4f58-888d-fc1593a6c971 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:48.616521 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dc9bea2b-4709-4f58-888d-fc1593a6c971 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:48.623692 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc9bea2b-4709-4f58-888d-fc1593a6c971 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:48.624146 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc9bea2b-4709-4f58-888d-fc1593a6c971 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:48.625173 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc9bea2b-4709-4f58-888d-fc1593a6c971 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:48.625375 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc9bea2b-4709-4f58-888d-fc1593a6c971 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:48.655989 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dc9bea2b-4709-4f58-888d-fc1593a6c971 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Jun 02 13:43:48.656884 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 474/971] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:48 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:49.668248 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a0ea2029-b41a-4066-9f46-79648851a2ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:49.669196 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a0ea2029-b41a-4066-9f46-79648851a2ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:49.675813 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0ea2029-b41a-4066-9f46-79648851a2ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:49.676263 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0ea2029-b41a-4066-9f46-79648851a2ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:49.677052 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0ea2029-b41a-4066-9f46-79648851a2ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:49.677486 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0ea2029-b41a-4066-9f46-79648851a2ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:49.706128 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a0ea2029-b41a-4066-9f46-79648851a2ec tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042494 Jun 02 13:43:49.706680 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 498/972] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:49 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:50.717422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bb60dfef-c10d-4d7f-b3a1-168353c9d48a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:50.718345 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bb60dfef-c10d-4d7f-b3a1-168353c9d48a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:50.725113 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb60dfef-c10d-4d7f-b3a1-168353c9d48a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:50.725588 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb60dfef-c10d-4d7f-b3a1-168353c9d48a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:50.726349 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb60dfef-c10d-4d7f-b3a1-168353c9d48a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:50.726783 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb60dfef-c10d-4d7f-b3a1-168353c9d48a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:50.755932 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bb60dfef-c10d-4d7f-b3a1-168353c9d48a tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042557 Jun 02 13:43:50.756537 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 475/973] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:50 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:51.767485 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cfa083d2-aa2b-465c-bb47-eb55eb5f85ed tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:51.768539 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cfa083d2-aa2b-465c-bb47-eb55eb5f85ed tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:51.770938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:51.777438 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cfa083d2-aa2b-465c-bb47-eb55eb5f85ed tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:51.777893 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cfa083d2-aa2b-465c-bb47-eb55eb5f85ed tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:51.778668 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cfa083d2-aa2b-465c-bb47-eb55eb5f85ed tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:51.779104 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cfa083d2-aa2b-465c-bb47-eb55eb5f85ed tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:51.809598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cfa083d2-aa2b-465c-bb47-eb55eb5f85ed tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046249 Jun 02 13:43:51.810172 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 499/974] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:51 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:52.821279 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3e28eaab-8ab0-45bb-b70f-dc17e3b5c3fe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:52.822728 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3e28eaab-8ab0-45bb-b70f-dc17e3b5c3fe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:52.829432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3e28eaab-8ab0-45bb-b70f-dc17e3b5c3fe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:52.829880 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3e28eaab-8ab0-45bb-b70f-dc17e3b5c3fe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:52.830630 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3e28eaab-8ab0-45bb-b70f-dc17e3b5c3fe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:52.831063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3e28eaab-8ab0-45bb-b70f-dc17e3b5c3fe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:52.859700 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3e28eaab-8ab0-45bb-b70f-dc17e3b5c3fe tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042375 Jun 02 13:43:52.860253 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 476/975] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:52 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:53.871568 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1a9b9c1d-3f00-4256-9f07-db03d8d24bb2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:53.872526 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1a9b9c1d-3f00-4256-9f07-db03d8d24bb2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:53.879471 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1a9b9c1d-3f00-4256-9f07-db03d8d24bb2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:53.879975 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1a9b9c1d-3f00-4256-9f07-db03d8d24bb2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:53.880811 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1a9b9c1d-3f00-4256-9f07-db03d8d24bb2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:53.881255 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1a9b9c1d-3f00-4256-9f07-db03d8d24bb2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:53.912965 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1a9b9c1d-3f00-4256-9f07-db03d8d24bb2 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Jun 02 13:43:53.913855 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 500/976] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:53 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:54.423044 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-52e160cf-ff4c-4756-8303-9e7a14113f2b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:54.423990 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-52e160cf-ff4c-4756-8303-9e7a14113f2b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:54.430344 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-52e160cf-ff4c-4756-8303-9e7a14113f2b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:54.431434 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-52e160cf-ff4c-4756-8303-9e7a14113f2b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:54.432207 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-52e160cf-ff4c-4756-8303-9e7a14113f2b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:54.432681 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-52e160cf-ff4c-4756-8303-9e7a14113f2b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:54.462648 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-52e160cf-ff4c-4756-8303-9e7a14113f2b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043483 Jun 02 13:43:54.463196 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 477/977] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:54 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:54.566444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5b656f8e-483b-4e66-8873-9eda2807a129 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:54.567005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5b656f8e-483b-4e66-8873-9eda2807a129 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:54.572995 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5b656f8e-483b-4e66-8873-9eda2807a129 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:54.573457 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5b656f8e-483b-4e66-8873-9eda2807a129 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:54.574230 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5b656f8e-483b-4e66-8873-9eda2807a129 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:54.574676 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5b656f8e-483b-4e66-8873-9eda2807a129 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:54.600006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:43:54.606835 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5b656f8e-483b-4e66-8873-9eda2807a129 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments/5a2c2833-7c36-4f98-93e2-f6c22f6e8827" status: 200 len: 194 microversion: 2.1 time: 0.044390 Jun 02 13:43:54.607858 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 501/978] 10.222.0.32 () {58 vars in 1412 bytes} [Thu Jun 2 13:43:54 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments/5a2c2833-7c36-4f98-93e2-f6c22f6e8827 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:54.617126 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-32839695-59d5-48e6-9974-f4738f6c9beb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:54.617620 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-32839695-59d5-48e6-9974-f4738f6c9beb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:54.623592 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32839695-59d5-48e6-9974-f4738f6c9beb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:54.624042 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32839695-59d5-48e6-9974-f4738f6c9beb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:54.624890 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32839695-59d5-48e6-9974-f4738f6c9beb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:54.625331 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-32839695-59d5-48e6-9974-f4738f6c9beb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:54.708097 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-32839695-59d5-48e6-9974-f4738f6c9beb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lazy-loading 'services' on Instance uuid feaca659-ff17-4177-bb50-c7475b2d2beb {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:43:54.778161 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-32839695-59d5-48e6-9974-f4738f6c9beb tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "DELETE /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments/5a2c2833-7c36-4f98-93e2-f6c22f6e8827" status: 202 len: 0 microversion: 2.1 time: 0.164786 Jun 02 13:43:54.778809 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 478/979] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:43:54 2022] DELETE /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments/5a2c2833-7c36-4f98-93e2-f6c22f6e8827 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:43:54.924933 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9faeda0a-370f-4442-8f46-c522cd754bbc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:54.925851 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9faeda0a-370f-4442-8f46-c522cd754bbc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:54.933681 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9faeda0a-370f-4442-8f46-c522cd754bbc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:54.934137 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9faeda0a-370f-4442-8f46-c522cd754bbc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:54.934941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9faeda0a-370f-4442-8f46-c522cd754bbc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:54.935453 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9faeda0a-370f-4442-8f46-c522cd754bbc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:54.965210 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9faeda0a-370f-4442-8f46-c522cd754bbc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044512 Jun 02 13:43:54.965769 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 502/980] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:43:54 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:43:55.022805 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-67322b3f-7c98-44d4-9401-12ba556481c0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:55.023394 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-67322b3f-7c98-44d4-9401-12ba556481c0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:55.029760 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67322b3f-7c98-44d4-9401-12ba556481c0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:55.030217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67322b3f-7c98-44d4-9401-12ba556481c0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:55.030980 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67322b3f-7c98-44d4-9401-12ba556481c0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:55.031426 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67322b3f-7c98-44d4-9401-12ba556481c0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:55.056836 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-67322b3f-7c98-44d4-9401-12ba556481c0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:43:55.129663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-67322b3f-7c98-44d4-9401-12ba556481c0 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 204 len: 0 microversion: 2.1 time: 0.110892 Jun 02 13:43:55.130153 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 479/981] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:43:55 2022] DELETE /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:43:55.138349 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c876698a-4108-4d00-b027-fff0e9b4885c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:55.138967 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c876698a-4108-4d00-b027-fff0e9b4885c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:55.145011 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c876698a-4108-4d00-b027-fff0e9b4885c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:55.145466 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c876698a-4108-4d00-b027-fff0e9b4885c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:55.146231 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c876698a-4108-4d00-b027-fff0e9b4885c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:55.146671 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c876698a-4108-4d00-b027-fff0e9b4885c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:55.273999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c876698a-4108-4d00-b027-fff0e9b4885c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:55.281529 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c876698a-4108-4d00-b027-fff0e9b4885c tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1679 microversion: 2.1 time: 0.147044 Jun 02 13:43:55.282095 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 503/982] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:55 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:56.051028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3292351c-fb3c-4af0-a1d5-81b9fde3defb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e0dc90c-f387-48e3-bdb3-402f5cbd8c84", "device": "/dev/sdb"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:43:56.052778 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3292351c-fb3c-4af0-a1d5-81b9fde3defb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:56.059252 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3292351c-fb3c-4af0-a1d5-81b9fde3defb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:56.059708 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3292351c-fb3c-4af0-a1d5-81b9fde3defb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:56.060514 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3292351c-fb3c-4af0-a1d5-81b9fde3defb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:56.060959 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3292351c-fb3c-4af0-a1d5-81b9fde3defb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:56.299064 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2c85b53e-f50d-48e3-a86d-9698fe069e7d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:56.299686 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2c85b53e-f50d-48e3-a86d-9698fe069e7d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:56.306692 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c85b53e-f50d-48e3-a86d-9698fe069e7d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:56.307143 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c85b53e-f50d-48e3-a86d-9698fe069e7d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:56.307910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c85b53e-f50d-48e3-a86d-9698fe069e7d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:56.308371 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c85b53e-f50d-48e3-a86d-9698fe069e7d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:56.437179 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2c85b53e-f50d-48e3-a86d-9698fe069e7d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:56.444536 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2c85b53e-f50d-48e3-a86d-9698fe069e7d tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1679 microversion: 2.1 time: 0.149362 Jun 02 13:43:56.445103 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 504/983] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:56 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:43:57.173370 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3292351c-fb3c-4af0-a1d5-81b9fde3defb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "POST /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.126457 Jun 02 13:43:57.173974 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 480/984] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:43:56 2022] POST /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54/os-volume_attachments => generated 194 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:57.463360 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e4e26715-0094-44af-b971-cdb56a3e3f5b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:57.463899 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e4e26715-0094-44af-b971-cdb56a3e3f5b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:57.470358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4e26715-0094-44af-b971-cdb56a3e3f5b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:57.470801 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4e26715-0094-44af-b971-cdb56a3e3f5b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:57.471561 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4e26715-0094-44af-b971-cdb56a3e3f5b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:57.471996 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4e26715-0094-44af-b971-cdb56a3e3f5b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:57.603758 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e4e26715-0094-44af-b971-cdb56a3e3f5b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:57.611315 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e4e26715-0094-44af-b971-cdb56a3e3f5b tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1679 microversion: 2.1 time: 0.152536 Jun 02 13:43:57.611891 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 505/985] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:57 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:58.629731 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-08a862bd-1841-4027-991c-5b645515d6eb req-e6aaaa26-1c3e-4917-8447-2f552fd422d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83", "name": "network-vif-deleted", "tag": "d1ad1964-f645-4ab1-ab1e-46f1e6771af4"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:43:58.631136 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-90d85e34-2dcf-4006-9af9-8af2174f62cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:58.632731 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-90d85e34-2dcf-4006-9af9-8af2174f62cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:58.641151 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-08a862bd-1841-4027-991c-5b645515d6eb req-e6aaaa26-1c3e-4917-8447-2f552fd422d7 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:58.641993 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-08a862bd-1841-4027-991c-5b645515d6eb req-e6aaaa26-1c3e-4917-8447-2f552fd422d7 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:58.643311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90d85e34-2dcf-4006-9af9-8af2174f62cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:58.644350 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90d85e34-2dcf-4006-9af9-8af2174f62cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:58.645292 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90d85e34-2dcf-4006-9af9-8af2174f62cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:58.645792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90d85e34-2dcf-4006-9af9-8af2174f62cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:58.655491 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-08a862bd-1841-4027-991c-5b645515d6eb req-e6aaaa26-1c3e-4917-8447-2f552fd422d7 service nova] Creating event network-vif-deleted:d1ad1964-f645-4ab1-ab1e-46f1e6771af4 for instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 on hv-cinder-83608 Jun 02 13:43:58.662884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-08a862bd-1841-4027-991c-5b645515d6eb req-e6aaaa26-1c3e-4917-8447-2f552fd422d7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036411 Jun 02 13:43:58.664544 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 506/986] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:43:58.748953 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-90d85e34-2dcf-4006-9af9-8af2174f62cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1622acb057f419ca98e7d44584c276d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a60aa73c3943e18fea2b2f38fadffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:43:58.759939 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-90d85e34-2dcf-4006-9af9-8af2174f62cc tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 200 len: 1612 microversion: 2.1 time: 0.133578 Jun 02 13:43:58.771968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 481/987] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:58 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 1612 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:43:59.047219 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4f180877-93e3-4b12-90d1-f9ab9b6c5821 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:59.047909 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4f180877-93e3-4b12-90d1-f9ab9b6c5821 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:59.054125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f180877-93e3-4b12-90d1-f9ab9b6c5821 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:59.054652 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f180877-93e3-4b12-90d1-f9ab9b6c5821 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:59.055506 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f180877-93e3-4b12-90d1-f9ab9b6c5821 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:59.056019 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f180877-93e3-4b12-90d1-f9ab9b6c5821 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:59.086580 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4f180877-93e3-4b12-90d1-f9ab9b6c5821 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments/0e09571d-a003-4ca1-bc0e-7eb24a061120" status: 200 len: 194 microversion: 2.1 time: 0.043724 Jun 02 13:43:59.087906 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 507/988] 10.222.0.32 () {58 vars in 1412 bytes} [Thu Jun 2 13:43:59 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments/0e09571d-a003-4ca1-bc0e-7eb24a061120 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:43:59.097524 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bb05e080-dc40-4eb3-8491-bc42d065c1a8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:59.098052 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bb05e080-dc40-4eb3-8491-bc42d065c1a8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:59.104554 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb05e080-dc40-4eb3-8491-bc42d065c1a8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:59.104946 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb05e080-dc40-4eb3-8491-bc42d065c1a8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:59.105711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb05e080-dc40-4eb3-8491-bc42d065c1a8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:59.106154 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb05e080-dc40-4eb3-8491-bc42d065c1a8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:59.188798 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-bb05e080-dc40-4eb3-8491-bc42d065c1a8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lazy-loading 'services' on Instance uuid feaca659-ff17-4177-bb50-c7475b2d2beb {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:43:59.272496 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bb05e080-dc40-4eb3-8491-bc42d065c1a8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "DELETE /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments/0e09571d-a003-4ca1-bc0e-7eb24a061120" status: 202 len: 0 microversion: 2.1 time: 0.178379 Jun 02 13:43:59.276250 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 482/989] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:43:59 2022] DELETE /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments/0e09571d-a003-4ca1-bc0e-7eb24a061120 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:43:59.778510 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f67ea551-1a22-4eaa-81a3-fafa28de1330 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:59.779129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f67ea551-1a22-4eaa-81a3-fafa28de1330 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:43:59.785929 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f67ea551-1a22-4eaa-81a3-fafa28de1330 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:59.786387 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f67ea551-1a22-4eaa-81a3-fafa28de1330 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:59.787686 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f67ea551-1a22-4eaa-81a3-fafa28de1330 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:43:59.788137 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f67ea551-1a22-4eaa-81a3-fafa28de1330 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:43:59.801892 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-f67ea551-1a22-4eaa-81a3-fafa28de1330 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f67ea551-1a22-4eaa-81a3-fafa28de1330 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 HTTP/1.1 Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:43:59.803519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:43:59.805183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83'} Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:43:59.806761 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:43:59.808333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:43:59.809939 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f67ea551-1a22-4eaa-81a3-fafa28de1330 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:43:59.809939 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f67ea551-1a22-4eaa-81a3-fafa28de1330 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 404 len: 111 microversion: 2.1 time: 0.030414 Jun 02 13:43:59.809939 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 508/990] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:43:59 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:43:59.815334 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ca2af0b9-c576-4864-8a5c-1c5867970246 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '.version_select at 0x7f86151aaca0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:43:59.832083 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ca2af0b9-c576-4864-8a5c-1c5867970246 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-633971284" status: 202 len: 0 microversion: 2.1 time: 0.021399 Jun 02 13:43:59.832660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 483/991] 10.222.0.32 () {58 vars in 1217 bytes} [Thu Jun 2 13:43:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-633971284 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:44:01.566396 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-31242ab4-1c19-46ac-a57e-7146d2d79c18 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:01.566886 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-31242ab4-1c19-46ac-a57e-7146d2d79c18 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:01.573988 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-31242ab4-1c19-46ac-a57e-7146d2d79c18 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:01.574442 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-31242ab4-1c19-46ac-a57e-7146d2d79c18 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:01.575206 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-31242ab4-1c19-46ac-a57e-7146d2d79c18 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:01.575642 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-31242ab4-1c19-46ac-a57e-7146d2d79c18 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:01.589031 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-31242ab4-1c19-46ac-a57e-7146d2d79c18 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-31242ab4-1c19-46ac-a57e-7146d2d79c18 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 HTTP/1.1 Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:01.590581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:44:01.592171 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83'} Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:01.593266 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:44:01.594746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:01.596446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-31242ab4-1c19-46ac-a57e-7146d2d79c18 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:01.596446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-31242ab4-1c19-46ac-a57e-7146d2d79c18 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 404 len: 111 microversion: 2.1 time: 0.029338 Jun 02 13:44:01.596446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 509/992] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:44:01 2022] DELETE /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:01.600721 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b67cd3eb-5275-483f-a0ef-eec40055ecff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:01.601463 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b67cd3eb-5275-483f-a0ef-eec40055ecff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:01.608282 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b67cd3eb-5275-483f-a0ef-eec40055ecff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:01.608764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b67cd3eb-5275-483f-a0ef-eec40055ecff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:01.609534 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b67cd3eb-5275-483f-a0ef-eec40055ecff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:01.609979 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b67cd3eb-5275-483f-a0ef-eec40055ecff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:01.623327 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-b67cd3eb-5275-483f-a0ef-eec40055ecff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b67cd3eb-5275-483f-a0ef-eec40055ecff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 HTTP/1.1 Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:01.624968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:44:01.626540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83'} Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:01.627425 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. Jun 02 13:44:01.628970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:01.630186 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b67cd3eb-5275-483f-a0ef-eec40055ecff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance 4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:01.630186 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b67cd3eb-5275-483f-a0ef-eec40055ecff tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83" status: 404 len: 111 microversion: 2.1 time: 0.030092 Jun 02 13:44:01.630186 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 484/993] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:01 2022] GET /compute/v2.1/servers/4d5a6153-6fcc-49f4-ac9a-cefe1b98ed83 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:02.760380 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6cd32ec3-a8dd-49d8-9705-44e23c6b2231 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:02.760954 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6cd32ec3-a8dd-49d8-9705-44e23c6b2231 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:02.767392 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6cd32ec3-a8dd-49d8-9705-44e23c6b2231 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.767845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6cd32ec3-a8dd-49d8-9705-44e23c6b2231 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.768641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6cd32ec3-a8dd-49d8-9705-44e23c6b2231 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.769082 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6cd32ec3-a8dd-49d8-9705-44e23c6b2231 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.782353 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-6cd32ec3-a8dd-49d8-9705-44e23c6b2231 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6cd32ec3-a8dd-49d8-9705-44e23c6b2231 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 HTTP/1.1 Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:02.783887 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:44:02.785515 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'd660d9e5-4816-47f4-b60a-922f53b35cd2'} Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:02.786694 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:44:02.788152 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.790199 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6cd32ec3-a8dd-49d8-9705-44e23c6b2231 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:02.790199 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6cd32ec3-a8dd-49d8-9705-44e23c6b2231 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 404 len: 111 microversion: 2.1 time: 0.028989 Jun 02 13:44:02.790199 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 510/994] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:44:02 2022] DELETE /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:02.801453 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c3930546-7ce9-497e-9b35-14a83ef75627 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:02.802074 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c3930546-7ce9-497e-9b35-14a83ef75627 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: d660d9e5-4816-47f4-b60a-922f53b35cd2] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:02.805115 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-17f1abed-c108-44d2-b7d0-5be2d8c9aba1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:02.806035 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-17f1abed-c108-44d2-b7d0-5be2d8c9aba1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:02.809403 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3930546-7ce9-497e-9b35-14a83ef75627 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.809855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3930546-7ce9-497e-9b35-14a83ef75627 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.810621 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3930546-7ce9-497e-9b35-14a83ef75627 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.811063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3930546-7ce9-497e-9b35-14a83ef75627 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.812650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17f1abed-c108-44d2-b7d0-5be2d8c9aba1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.813011 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17f1abed-c108-44d2-b7d0-5be2d8c9aba1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.813776 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17f1abed-c108-44d2-b7d0-5be2d8c9aba1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.814214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17f1abed-c108-44d2-b7d0-5be2d8c9aba1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.824348 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-c3930546-7ce9-497e-9b35-14a83ef75627 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c3930546-7ce9-497e-9b35-14a83ef75627 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 HTTP/1.1 Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:02.825867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:44:02.828612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': 'd660d9e5-4816-47f4-b60a-922f53b35cd2'} Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:02.829549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. Jun 02 13:44:02.831028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.832994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c3930546-7ce9-497e-9b35-14a83ef75627 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance d660d9e5-4816-47f4-b60a-922f53b35cd2 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:02.832994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c3930546-7ce9-497e-9b35-14a83ef75627 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2" status: 404 len: 111 microversion: 2.1 time: 0.037673 Jun 02 13:44:02.832994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 485/995] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:02 2022] GET /compute/v2.1/servers/d660d9e5-4816-47f4-b60a-922f53b35cd2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:02.835832 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-786de9f7-45ba-4b31-b4eb-e77698a76900 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:02.836344 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-786de9f7-45ba-4b31-b4eb-e77698a76900 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:02.842675 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-786de9f7-45ba-4b31-b4eb-e77698a76900 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.843129 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-786de9f7-45ba-4b31-b4eb-e77698a76900 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.843421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-17f1abed-c108-44d2-b7d0-5be2d8c9aba1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042054 Jun 02 13:44:02.843896 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-786de9f7-45ba-4b31-b4eb-e77698a76900 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.843994 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 511/996] 10.222.0.32 () {60 vars in 1342 bytes} [Thu Jun 2 13:44:02 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:44:02.844360 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-786de9f7-45ba-4b31-b4eb-e77698a76900 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.858363 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-786de9f7-45ba-4b31-b4eb-e77698a76900 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-786de9f7-45ba-4b31-b4eb-e77698a76900 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec HTTP/1.1 Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:02.859897 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:44:02.861525 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec'} Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:02.862861 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:44:02.864315 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.865996 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-786de9f7-45ba-4b31-b4eb-e77698a76900 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:02.865996 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-786de9f7-45ba-4b31-b4eb-e77698a76900 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 404 len: 111 microversion: 2.1 time: 0.029189 Jun 02 13:44:02.865996 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 486/997] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:44:02 2022] DELETE /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:44:02.869623 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7573288c-a62b-40d0-b3a1-743b375cc435 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:02.870306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7573288c-a62b-40d0-b3a1-743b375cc435 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:02.876511 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7573288c-a62b-40d0-b3a1-743b375cc435 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.876938 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7573288c-a62b-40d0-b3a1-743b375cc435 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.877707 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7573288c-a62b-40d0-b3a1-743b375cc435 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.878148 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7573288c-a62b-40d0-b3a1-743b375cc435 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.891442 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-7573288c-a62b-40d0-b3a1-743b375cc435 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7573288c-a62b-40d0-b3a1-743b375cc435 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec HTTP/1.1 Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:02.893026 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:44:02.894591 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec'} Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:02.895386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. Jun 02 13:44:02.896643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:02.897911 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7573288c-a62b-40d0-b3a1-743b375cc435 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance 955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:02.897911 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7573288c-a62b-40d0-b3a1-743b375cc435 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec" status: 404 len: 111 microversion: 2.1 time: 0.028585 Jun 02 13:44:02.897911 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 512/998] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:02 2022] GET /compute/v2.1/servers/955c2c1a-608d-4ca0-99f7-3e58aa0ee8ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:02.907825 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-73dc2ca1-6246-48ad-ad3e-097c09a6ecf1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:02.908340 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-73dc2ca1-6246-48ad-ad3e-097c09a6ecf1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:02.914269 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73dc2ca1-6246-48ad-ad3e-097c09a6ecf1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.914718 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73dc2ca1-6246-48ad-ad3e-097c09a6ecf1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.915499 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73dc2ca1-6246-48ad-ad3e-097c09a6ecf1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:02.915934 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73dc2ca1-6246-48ad-ad3e-097c09a6ecf1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:02.941591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-73dc2ca1-6246-48ad-ad3e-097c09a6ecf1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:44:02.969360 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:03.025029 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-73dc2ca1-6246-48ad-ad3e-097c09a6ecf1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 204 len: 0 microversion: 2.20 time: 0.120448 Jun 02 13:44:03.025848 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 487/999] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Jun 2 13:44:02 2022] DELETE /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 13:44:03.034311 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fbb651e8-de2b-4eaa-9929-cafe5e2786a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:03.034928 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fbb651e8-de2b-4eaa-9929-cafe5e2786a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:03.040944 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fbb651e8-de2b-4eaa-9929-cafe5e2786a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:03.041398 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fbb651e8-de2b-4eaa-9929-cafe5e2786a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:03.042828 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fbb651e8-de2b-4eaa-9929-cafe5e2786a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:03.043263 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fbb651e8-de2b-4eaa-9929-cafe5e2786a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:03.169028 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fbb651e8-de2b-4eaa-9929-cafe5e2786a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:03.176919 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fbb651e8-de2b-4eaa-9929-cafe5e2786a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:03.178426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fbb651e8-de2b-4eaa-9929-cafe5e2786a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:03.179577 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fbb651e8-de2b-4eaa-9929-cafe5e2786a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.149183 Jun 02 13:44:03.180129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 513/1000] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:44:03 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:44:04.028856 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-922f3035-aed0-473a-9db2-d1fb5582a7ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:04.029449 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-922f3035-aed0-473a-9db2-d1fb5582a7ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:04.035929 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-922f3035-aed0-473a-9db2-d1fb5582a7ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:04.036416 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-922f3035-aed0-473a-9db2-d1fb5582a7ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:04.037188 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-922f3035-aed0-473a-9db2-d1fb5582a7ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:04.037631 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-922f3035-aed0-473a-9db2-d1fb5582a7ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:04.051461 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-922f3035-aed0-473a-9db2-d1fb5582a7ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-922f3035-aed0-473a-9db2-d1fb5582a7ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 HTTP/1.1 Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:04.053127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:44:04.054444 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '123ffac0-b1c6-4d56-a959-9dddf4e649c3'} Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:04.055179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:44:04.056543 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:04.058910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-922f3035-aed0-473a-9db2-d1fb5582a7ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:04.058910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-922f3035-aed0-473a-9db2-d1fb5582a7ac tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "DELETE /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 404 len: 111 microversion: 2.1 time: 0.029938 Jun 02 13:44:04.058910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 488/1001] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:44:04 2022] DELETE /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:04.063533 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2a573ce1-f569-4562-9ca2-ad6ae77c3173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:04.064153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2a573ce1-f569-4562-9ca2-ad6ae77c3173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] [instance: 123ffac0-b1c6-4d56-a959-9dddf4e649c3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:04.070749 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a573ce1-f569-4562-9ca2-ad6ae77c3173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:04.071207 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a573ce1-f569-4562-9ca2-ad6ae77c3173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:04.071970 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a573ce1-f569-4562-9ca2-ad6ae77c3173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:04.072447 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a573ce1-f569-4562-9ca2-ad6ae77c3173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:04.086008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-2a573ce1-f569-4562-9ca2-ad6ae77c3173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] HTTP exception thrown: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2a573ce1-f569-4562-9ca2-ad6ae77c3173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Request method failure captured: Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 HTTP/1.1 Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzUFp33nS26nJKfzX55UB3a50WwAUxWnR56pUV3bvB6PPJLFI9XsVPEYpL-YDuM7bCV2DiKpaklIEQ2zha05IC0OajLOTMx7gJjtA5s7tMHrjSMutAKdr8IdosbQCThpsD8o7Q7nml9iKyPniItZE-SYmw_Jj0frXgc8AmEu2DH7cg Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:04.087537 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e2a60aa73c3943e18fea2b2f38fadffe"}]}] Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: e2a60aa73c3943e18fea2b2f38fadffe Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1675309251 Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: a1622acb057f419ca98e7d44584c276d Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1675309251-project Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:44:04.089237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '123ffac0-b1c6-4d56-a959-9dddf4e649c3'} Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:04.090309 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. Jun 02 13:44:04.091789 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:04.093367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2a573ce1-f569-4562-9ca2-ad6ae77c3173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] Returning 404 to user: Instance 123ffac0-b1c6-4d56-a959-9dddf4e649c3 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:04.093367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2a573ce1-f569-4562-9ca2-ad6ae77c3173 tempest-AttachVolumeNegativeTest-1675309251 tempest-AttachVolumeNegativeTest-1675309251-project] 10.222.0.32 "GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3" status: 404 len: 111 microversion: 2.1 time: 0.029263 Jun 02 13:44:04.093367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 514/1002] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:04 2022] GET /compute/v2.1/servers/123ffac0-b1c6-4d56-a959-9dddf4e649c3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:04.197745 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ca072ab6-d01b-4b8d-96bf-a9e05ef5a4d8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:04.198418 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ca072ab6-d01b-4b8d-96bf-a9e05ef5a4d8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:04.204904 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ca072ab6-d01b-4b8d-96bf-a9e05ef5a4d8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:04.205363 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ca072ab6-d01b-4b8d-96bf-a9e05ef5a4d8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:04.206137 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ca072ab6-d01b-4b8d-96bf-a9e05ef5a4d8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:04.206582 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ca072ab6-d01b-4b8d-96bf-a9e05ef5a4d8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:04.425192 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ca072ab6-d01b-4b8d-96bf-a9e05ef5a4d8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:04.433615 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ca072ab6-d01b-4b8d-96bf-a9e05ef5a4d8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:04.435140 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ca072ab6-d01b-4b8d-96bf-a9e05ef5a4d8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:04.436540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ca072ab6-d01b-4b8d-96bf-a9e05ef5a4d8 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.242472 Jun 02 13:44:04.437459 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 489/1003] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:44:04 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:44:05.456086 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a8e97a43-a643-485f-85d7-86cd87c9fcd3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:05.456795 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a8e97a43-a643-485f-85d7-86cd87c9fcd3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:05.475481 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8e97a43-a643-485f-85d7-86cd87c9fcd3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:05.475897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8e97a43-a643-485f-85d7-86cd87c9fcd3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:05.476747 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8e97a43-a643-485f-85d7-86cd87c9fcd3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:05.477239 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8e97a43-a643-485f-85d7-86cd87c9fcd3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:05.842422 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a8e97a43-a643-485f-85d7-86cd87c9fcd3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:05.851703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a8e97a43-a643-485f-85d7-86cd87c9fcd3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:05.853279 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a8e97a43-a643-485f-85d7-86cd87c9fcd3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:05.854474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a8e97a43-a643-485f-85d7-86cd87c9fcd3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1725 microversion: 2.20 time: 0.403003 Jun 02 13:44:05.855027 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 515/1004] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:44:05 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1725 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 13:44:06.665453 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-3bab1099-97a5-48be-92d6-f17a71e71da4 req-77b9aa84-0d65-4a4d-83ab-9f11cd7dce5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5608f7cb-9e96-4916-87e2-1f6efd94cae1", "name": "network-vif-deleted", "tag": "081d1d87-4ea1-402c-a462-22f03273d76c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:06.673998 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:06.681676 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3bab1099-97a5-48be-92d6-f17a71e71da4 req-77b9aa84-0d65-4a4d-83ab-9f11cd7dce5c service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:06.682344 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3bab1099-97a5-48be-92d6-f17a71e71da4 req-77b9aa84-0d65-4a4d-83ab-9f11cd7dce5c service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:06.699864 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-3bab1099-97a5-48be-92d6-f17a71e71da4 req-77b9aa84-0d65-4a4d-83ab-9f11cd7dce5c service nova] Creating event network-vif-deleted:081d1d87-4ea1-402c-a462-22f03273d76c for instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 on hv-cinder-83608 Jun 02 13:44:06.709844 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-3bab1099-97a5-48be-92d6-f17a71e71da4 req-77b9aa84-0d65-4a4d-83ab-9f11cd7dce5c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048069 Jun 02 13:44:06.715628 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 490/1005] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:06.874433 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-29651c2f-dc2c-4adf-90a8-18179c1f7e5c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:06.875060 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-29651c2f-dc2c-4adf-90a8-18179c1f7e5c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:06.895490 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-29651c2f-dc2c-4adf-90a8-18179c1f7e5c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:06.895956 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-29651c2f-dc2c-4adf-90a8-18179c1f7e5c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:06.896787 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-29651c2f-dc2c-4adf-90a8-18179c1f7e5c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:06.897229 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-29651c2f-dc2c-4adf-90a8-18179c1f7e5c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:07.027419 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-29651c2f-dc2c-4adf-90a8-18179c1f7e5c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:07.049604 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-29651c2f-dc2c-4adf-90a8-18179c1f7e5c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:07.051602 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-29651c2f-dc2c-4adf-90a8-18179c1f7e5c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:07.053114 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-29651c2f-dc2c-4adf-90a8-18179c1f7e5c tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1657 microversion: 2.20 time: 0.183934 Jun 02 13:44:07.064890 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 516/1006] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:44:06 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1657 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:44:08.073086 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-960a1476-7583-4f16-b464-6f8ec793c44b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:08.075419 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-960a1476-7583-4f16-b464-6f8ec793c44b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:08.088351 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-960a1476-7583-4f16-b464-6f8ec793c44b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:08.089065 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-960a1476-7583-4f16-b464-6f8ec793c44b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:08.090776 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-960a1476-7583-4f16-b464-6f8ec793c44b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:08.091440 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-960a1476-7583-4f16-b464-6f8ec793c44b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:08.162337 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-960a1476-7583-4f16-b464-6f8ec793c44b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:08.171165 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-960a1476-7583-4f16-b464-6f8ec793c44b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:08.172774 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-960a1476-7583-4f16-b464-6f8ec793c44b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88bc03c141d64772b606e087d86e973e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e9e2d5c93274eb781bd76912178bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:08.173983 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-960a1476-7583-4f16-b464-6f8ec793c44b tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 200 len: 1367 microversion: 2.20 time: 0.106441 Jun 02 13:44:08.174544 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 491/1007] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:44:08 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 13:44:09.193278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d0f8e171-0a1e-43b9-81a0-a815aeed76a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:09.194004 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d0f8e171-0a1e-43b9-81a0-a815aeed76a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:09.201223 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d0f8e171-0a1e-43b9-81a0-a815aeed76a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:09.201668 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d0f8e171-0a1e-43b9-81a0-a815aeed76a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:09.202689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d0f8e171-0a1e-43b9-81a0-a815aeed76a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:09.203125 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d0f8e171-0a1e-43b9-81a0-a815aeed76a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:09.225117 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-d0f8e171-0a1e-43b9-81a0-a815aeed76a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] HTTP exception thrown: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d0f8e171-0a1e-43b9-81a0-a815aeed76a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Request method failure captured: Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 HTTP/1.1 Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzbvSGfosj-rWtsFuiX_rU9A2m98kW1MgwJEi0KIcrNgT5YAPGEquRQAOdnMmNmXJd17U0W_GONeAwZ1VNjdltAOlJKDuGtsDYEQxJJhv-Xtd32UGfUcIvChbZpJK2Fubj9-GlcBkjmHltpZxbAP9uqqf9h2xrVABwuxF5eYueZCkk Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:09.226897 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}] Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 88bc03c141d64772b606e087d86e973e Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:09.228635 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '5608f7cb-9e96-4916-87e2-1f6efd94cae1'} Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:09.229582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:09.231050 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:09.233194 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d0f8e171-0a1e-43b9-81a0-a815aeed76a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Returning 404 to user: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:09.233194 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d0f8e171-0a1e-43b9-81a0-a815aeed76a3 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 404 len: 111 microversion: 2.20 time: 0.038927 Jun 02 13:44:09.237504 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-77417902-feb8-438a-867b-ffb3ae516954 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '.version_select at 0x7f8614ffc9d0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:09.243386 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 517/1008] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:44:09 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:44:09.257633 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-77417902-feb8-438a-867b-ffb3ae516954 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500762851" status: 204 len: 0 microversion: 2.20 time: 0.023728 Jun 02 13:44:09.258496 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 492/1009] 10.222.0.32 () {60 vars in 1261 bytes} [Thu Jun 2 13:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500762851 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 13:44:10.045160 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1af10de8-1f8d-4134-b712-ffe5714f5618 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:10.046140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1af10de8-1f8d-4134-b712-ffe5714f5618 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:10.052496 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1af10de8-1f8d-4134-b712-ffe5714f5618 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:10.053174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1af10de8-1f8d-4134-b712-ffe5714f5618 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:10.053971 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1af10de8-1f8d-4134-b712-ffe5714f5618 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:10.054586 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1af10de8-1f8d-4134-b712-ffe5714f5618 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:10.083968 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1af10de8-1f8d-4134-b712-ffe5714f5618 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043221 Jun 02 13:44:10.089162 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 518/1010] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:44:10 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 13:44:10.272113 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fbf7b50a-e8e9-48e4-adc4-a8d0213c5a58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:10.273751 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fbf7b50a-e8e9-48e4-adc4-a8d0213c5a58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:10.282325 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbf7b50a-e8e9-48e4-adc4-a8d0213c5a58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:10.283074 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbf7b50a-e8e9-48e4-adc4-a8d0213c5a58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:10.283967 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbf7b50a-e8e9-48e4-adc4-a8d0213c5a58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:10.284516 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbf7b50a-e8e9-48e4-adc4-a8d0213c5a58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:10.319511 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fbf7b50a-e8e9-48e4-adc4-a8d0213c5a58 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051649 Jun 02 13:44:10.320091 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 493/1011] 10.222.0.32 () {58 vars in 1301 bytes} [Thu Jun 2 13:44:10 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 13:44:10.381006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e73c92fa-1762-48b9-9dad-859a8fb4444d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:10.381508 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e73c92fa-1762-48b9-9dad-859a8fb4444d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:10.387913 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e73c92fa-1762-48b9-9dad-859a8fb4444d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:10.388431 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e73c92fa-1762-48b9-9dad-859a8fb4444d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:10.389376 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e73c92fa-1762-48b9-9dad-859a8fb4444d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:10.389860 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e73c92fa-1762-48b9-9dad-859a8fb4444d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:10.415894 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e73c92fa-1762-48b9-9dad-859a8fb4444d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:44:10.490366 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e73c92fa-1762-48b9-9dad-859a8fb4444d tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "DELETE /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 204 len: 0 microversion: 2.1 time: 0.112892 Jun 02 13:44:10.491021 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 519/1012] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:44:10 2022] DELETE /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:44:10.499460 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c623df75-7be5-4eaf-a387-ce8b40612851 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:10.500071 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c623df75-7be5-4eaf-a387-ce8b40612851 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:10.506104 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c623df75-7be5-4eaf-a387-ce8b40612851 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:10.506553 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c623df75-7be5-4eaf-a387-ce8b40612851 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:10.507319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c623df75-7be5-4eaf-a387-ce8b40612851 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:10.507756 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c623df75-7be5-4eaf-a387-ce8b40612851 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:10.634971 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c623df75-7be5-4eaf-a387-ce8b40612851 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:10.642426 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c623df75-7be5-4eaf-a387-ce8b40612851 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1673 microversion: 2.1 time: 0.146840 Jun 02 13:44:10.642982 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 494/1013] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:10 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:11.042459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f9313039-faa9-452a-9fde-5843729d19ff tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:11.043045 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f9313039-faa9-452a-9fde-5843729d19ff tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:11.048973 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9313039-faa9-452a-9fde-5843729d19ff tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:11.049422 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9313039-faa9-452a-9fde-5843729d19ff tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:11.050177 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9313039-faa9-452a-9fde-5843729d19ff tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:11.050609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9313039-faa9-452a-9fde-5843729d19ff tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:11.064105 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-f9313039-faa9-452a-9fde-5843729d19ff tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] HTTP exception thrown: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f9313039-faa9-452a-9fde-5843729d19ff tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Request method failure captured: Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 HTTP/1.1 Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzbvSGfosj-rWtsFuiX_rU9A2m98kW1MgwJEi0KIcrNgT5YAPGEquRQAOdnMmNmXJd17U0W_GONeAwZ1VNjdltAOlJKDuGtsDYEQxJJhv-Xtd32UGfUcIvChbZpJK2Fubj9-GlcBkjmHltpZxbAP9uqqf9h2xrVABwuxF5eYueZCkk Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:11.065738 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}] Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 88bc03c141d64772b606e087d86e973e Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:11.067358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '5608f7cb-9e96-4916-87e2-1f6efd94cae1'} Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:11.068417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:11.069618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:11.070957 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f9313039-faa9-452a-9fde-5843729d19ff tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Returning 404 to user: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:11.070957 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f9313039-faa9-452a-9fde-5843729d19ff tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 404 len: 111 microversion: 2.20 time: 0.028838 Jun 02 13:44:11.070957 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 520/1014] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Jun 2 13:44:11 2022] DELETE /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:44:11.075912 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1a417708-6f89-437d-8d78-33b6e15323a0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:11.076555 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1a417708-6f89-437d-8d78-33b6e15323a0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: 5608f7cb-9e96-4916-87e2-1f6efd94cae1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:11.082809 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a417708-6f89-437d-8d78-33b6e15323a0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:11.083255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a417708-6f89-437d-8d78-33b6e15323a0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:11.084010 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a417708-6f89-437d-8d78-33b6e15323a0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:11.084490 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a417708-6f89-437d-8d78-33b6e15323a0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:11.097379 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-1a417708-6f89-437d-8d78-33b6e15323a0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] HTTP exception thrown: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1a417708-6f89-437d-8d78-33b6e15323a0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Request method failure captured: Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 HTTP/1.1 Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzbvSGfosj-rWtsFuiX_rU9A2m98kW1MgwJEi0KIcrNgT5YAPGEquRQAOdnMmNmXJd17U0W_GONeAwZ1VNjdltAOlJKDuGtsDYEQxJJhv-Xtd32UGfUcIvChbZpJK2Fubj9-GlcBkjmHltpZxbAP9uqqf9h2xrVABwuxF5eYueZCkk Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:11.099018 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}] Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 88bc03c141d64772b606e087d86e973e Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:11.100682 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '5608f7cb-9e96-4916-87e2-1f6efd94cae1'} Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:11.101730 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. Jun 02 13:44:11.103172 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:11.104650 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1a417708-6f89-437d-8d78-33b6e15323a0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Returning 404 to user: Instance 5608f7cb-9e96-4916-87e2-1f6efd94cae1 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:11.104650 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1a417708-6f89-437d-8d78-33b6e15323a0 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1" status: 404 len: 111 microversion: 2.20 time: 0.028918 Jun 02 13:44:11.104650 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 495/1015] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:44:11 2022] GET /compute/v2.1/servers/5608f7cb-9e96-4916-87e2-1f6efd94cae1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:44:11.659873 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-13c13487-3738-484b-9f98-cb40eb352625 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:11.660545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-13c13487-3738-484b-9f98-cb40eb352625 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:11.667656 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-13c13487-3738-484b-9f98-cb40eb352625 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:11.668108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-13c13487-3738-484b-9f98-cb40eb352625 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:11.668966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-13c13487-3738-484b-9f98-cb40eb352625 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:11.669411 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-13c13487-3738-484b-9f98-cb40eb352625 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:11.804657 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-13c13487-3738-484b-9f98-cb40eb352625 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:11.812603 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-13c13487-3738-484b-9f98-cb40eb352625 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1673 microversion: 2.1 time: 0.156575 Jun 02 13:44:11.813165 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 521/1016] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:11 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:12.829811 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b1d83c45-8c97-417a-b0cd-cb14d6bbd4c5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:12.830427 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b1d83c45-8c97-417a-b0cd-cb14d6bbd4c5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:12.837004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1d83c45-8c97-417a-b0cd-cb14d6bbd4c5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:12.837454 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1d83c45-8c97-417a-b0cd-cb14d6bbd4c5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:12.838218 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1d83c45-8c97-417a-b0cd-cb14d6bbd4c5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:12.839180 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1d83c45-8c97-417a-b0cd-cb14d6bbd4c5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:12.968276 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b1d83c45-8c97-417a-b0cd-cb14d6bbd4c5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:12.975679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b1d83c45-8c97-417a-b0cd-cb14d6bbd4c5 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1673 microversion: 2.1 time: 0.150027 Jun 02 13:44:12.976233 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 496/1017] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:12 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:13.993093 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9d41c51f-46ae-4767-bf1b-6b6ba7083266 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:13.993722 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9d41c51f-46ae-4767-bf1b-6b6ba7083266 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:14.000447 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9d41c51f-46ae-4767-bf1b-6b6ba7083266 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:14.000900 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9d41c51f-46ae-4767-bf1b-6b6ba7083266 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:14.001685 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9d41c51f-46ae-4767-bf1b-6b6ba7083266 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:14.002127 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9d41c51f-46ae-4767-bf1b-6b6ba7083266 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:14.023773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:14.217279 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9d41c51f-46ae-4767-bf1b-6b6ba7083266 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:14.225367 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9d41c51f-46ae-4767-bf1b-6b6ba7083266 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1673 microversion: 2.1 time: 0.236280 Jun 02 13:44:14.226045 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 522/1018] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:13 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1673 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:14.335683 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-74a90c5d-6393-45f4-bd81-b1c3621f1ab5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:14.336292 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-74a90c5d-6393-45f4-bd81-b1c3621f1ab5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:14.343031 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74a90c5d-6393-45f4-bd81-b1c3621f1ab5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:14.343869 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74a90c5d-6393-45f4-bd81-b1c3621f1ab5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:14.344778 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74a90c5d-6393-45f4-bd81-b1c3621f1ab5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:14.345285 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74a90c5d-6393-45f4-bd81-b1c3621f1ab5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:14.360391 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-74a90c5d-6393-45f4-bd81-b1c3621f1ab5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] HTTP exception thrown: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-74a90c5d-6393-45f4-bd81-b1c3621f1ab5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Request method failure captured: Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 HTTP/1.1 Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzbvSGfosj-rWtsFuiX_rU9A2m98kW1MgwJEi0KIcrNgT5YAPGEquRQAOdnMmNmXJd17U0W_GONeAwZ1VNjdltAOlJKDuGtsDYEQxJJhv-Xtd32UGfUcIvChbZpJK2Fubj9-GlcBkjmHltpZxbAP9uqqf9h2xrVABwuxF5eYueZCkk Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:14.362526 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}] Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 88bc03c141d64772b606e087d86e973e Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:44:14.364045 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': 'bf15208f-0bda-407c-8ea0-38a1300bfa16'} Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:14.365470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:44:14.366791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:14.371278 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-74a90c5d-6393-45f4-bd81-b1c3621f1ab5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Returning 404 to user: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:14.371278 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-74a90c5d-6393-45f4-bd81-b1c3621f1ab5 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 404 len: 111 microversion: 2.20 time: 0.032562 Jun 02 13:44:14.371278 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 497/1019] 10.222.0.32 () {60 vars in 1279 bytes} [Thu Jun 2 13:44:14 2022] DELETE /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:44:14.374342 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fca73e8e-2267-4764-92bc-d25ee8ef6ea1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:14.374961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fca73e8e-2267-4764-92bc-d25ee8ef6ea1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] [instance: bf15208f-0bda-407c-8ea0-38a1300bfa16] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:14.380954 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fca73e8e-2267-4764-92bc-d25ee8ef6ea1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:14.381411 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fca73e8e-2267-4764-92bc-d25ee8ef6ea1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:14.382187 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fca73e8e-2267-4764-92bc-d25ee8ef6ea1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:14.382807 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fca73e8e-2267-4764-92bc-d25ee8ef6ea1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:14.397441 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-fca73e8e-2267-4764-92bc-d25ee8ef6ea1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] HTTP exception thrown: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fca73e8e-2267-4764-92bc-d25ee8ef6ea1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Request method failure captured: Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 HTTP/1.1 Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzbvSGfosj-rWtsFuiX_rU9A2m98kW1MgwJEi0KIcrNgT5YAPGEquRQAOdnMmNmXJd17U0W_GONeAwZ1VNjdltAOlJKDuGtsDYEQxJJhv-Xtd32UGfUcIvChbZpJK2Fubj9-GlcBkjmHltpZxbAP9uqqf9h2xrVABwuxF5eYueZCkk Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:14.398986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/8e9e2d5c93274eb781bd76912178bae6"}]}] Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 8e9e2d5c93274eb781bd76912178bae6 Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-573892680 Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 88bc03c141d64772b606e087d86e973e Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeShelveTestJSON-573892680-project Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:44:14.400505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'bf15208f-0bda-407c-8ea0-38a1300bfa16'} Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:14.401306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. Jun 02 13:44:14.402670 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:14.403782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fca73e8e-2267-4764-92bc-d25ee8ef6ea1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] Returning 404 to user: Instance bf15208f-0bda-407c-8ea0-38a1300bfa16 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:14.403782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fca73e8e-2267-4764-92bc-d25ee8ef6ea1 tempest-AttachVolumeShelveTestJSON-573892680 tempest-AttachVolumeShelveTestJSON-573892680-project] 10.222.0.32 "GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16" status: 404 len: 111 microversion: 2.20 time: 0.030863 Jun 02 13:44:14.403782 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 523/1020] 10.222.0.32 () {60 vars in 1276 bytes} [Thu Jun 2 13:44:14 2022] GET /compute/v2.1/servers/bf15208f-0bda-407c-8ea0-38a1300bfa16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 13:44:15.205435 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-c384bdc4-1d45-4227-8d03-958617a0b2be req-11319e1f-f4cc-47c5-be12-6a6acb37b733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feaca659-ff17-4177-bb50-c7475b2d2beb", "name": "network-vif-deleted", "tag": "cf2c6b43-4d83-4ce3-ac62-55fe9f7dbc4d"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:15.213874 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-c384bdc4-1d45-4227-8d03-958617a0b2be req-11319e1f-f4cc-47c5-be12-6a6acb37b733 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:15.214361 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-c384bdc4-1d45-4227-8d03-958617a0b2be req-11319e1f-f4cc-47c5-be12-6a6acb37b733 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:15.226290 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-c384bdc4-1d45-4227-8d03-958617a0b2be req-11319e1f-f4cc-47c5-be12-6a6acb37b733 service nova] Creating event network-vif-deleted:cf2c6b43-4d83-4ce3-ac62-55fe9f7dbc4d for instance feaca659-ff17-4177-bb50-c7475b2d2beb on hv-cinder-83608 Jun 02 13:44:15.231985 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-c384bdc4-1d45-4227-8d03-958617a0b2be req-11319e1f-f4cc-47c5-be12-6a6acb37b733 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030442 Jun 02 13:44:15.232640 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 498/1021] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:15.242974 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bea7b932-9526-4391-a896-349331120533 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:15.244237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bea7b932-9526-4391-a896-349331120533 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:15.251626 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bea7b932-9526-4391-a896-349331120533 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:15.252354 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bea7b932-9526-4391-a896-349331120533 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:15.253147 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bea7b932-9526-4391-a896-349331120533 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:15.253745 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bea7b932-9526-4391-a896-349331120533 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:15.319359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bea7b932-9526-4391-a896-349331120533 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:15.327143 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bea7b932-9526-4391-a896-349331120533 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1606 microversion: 2.1 time: 0.087872 Jun 02 13:44:15.328113 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 524/1022] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:15 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:16.348498 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d429e2ba-cf35-4f71-9013-8c3b26b501d9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:16.350199 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d429e2ba-cf35-4f71-9013-8c3b26b501d9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:16.357657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d429e2ba-cf35-4f71-9013-8c3b26b501d9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:16.357657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d429e2ba-cf35-4f71-9013-8c3b26b501d9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:16.358542 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d429e2ba-cf35-4f71-9013-8c3b26b501d9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:16.358893 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d429e2ba-cf35-4f71-9013-8c3b26b501d9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:16.437474 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d429e2ba-cf35-4f71-9013-8c3b26b501d9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:16.445340 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d429e2ba-cf35-4f71-9013-8c3b26b501d9 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1606 microversion: 2.1 time: 0.102704 Jun 02 13:44:16.445935 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 499/1023] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:16 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1606 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:17.463051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-575072c4-5ee6-46ca-8330-9065a9020d60 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:17.463617 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-575072c4-5ee6-46ca-8330-9065a9020d60 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:17.471055 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-575072c4-5ee6-46ca-8330-9065a9020d60 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:17.471512 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-575072c4-5ee6-46ca-8330-9065a9020d60 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:17.472290 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-575072c4-5ee6-46ca-8330-9065a9020d60 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:17.472871 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-575072c4-5ee6-46ca-8330-9065a9020d60 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:17.544742 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-575072c4-5ee6-46ca-8330-9065a9020d60 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e88422338024035b5c64d2788965086', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39255fa001f44b29a23006adf9c1a10d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:17.554888 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-575072c4-5ee6-46ca-8330-9065a9020d60 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 200 len: 1322 microversion: 2.1 time: 0.095700 Jun 02 13:44:17.556663 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 525/1024] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:17 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 1322 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:44:18.571694 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8751e779-2e12-49c5-914f-258ce1bb6bf0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:18.572968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8751e779-2e12-49c5-914f-258ce1bb6bf0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:18.579743 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8751e779-2e12-49c5-914f-258ce1bb6bf0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:18.580203 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8751e779-2e12-49c5-914f-258ce1bb6bf0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:18.581013 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8751e779-2e12-49c5-914f-258ce1bb6bf0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:18.581458 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8751e779-2e12-49c5-914f-258ce1bb6bf0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:18.596777 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-8751e779-2e12-49c5-914f-258ce1bb6bf0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] HTTP exception thrown: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8751e779-2e12-49c5-914f-258ce1bb6bf0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Request method failure captured: Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb HTTP/1.1 Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzbigMGsV69hp-9UjsF2kBzz18OMivkkIlocYD4sWJYe58ggsVEjRBn1ecTO5KNSsRz3XbHDQIcs5LfBS1Rz4pR07rIuYImr1CYCqmFJNgP4tSXx9OlAHJEwyZLgZqZ6gBzF9s_qkQ2T8L1xzLG31hoE5TTSHCiCbhJw0eCIlBGOGw Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:18.598674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}] Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 4e88422338024035b5c64d2788965086 Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:18.600059 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': 'feaca659-ff17-4177-bb50-c7475b2d2beb'} Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:18.600855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:18.602070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:18.603159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8751e779-2e12-49c5-914f-258ce1bb6bf0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Returning 404 to user: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:18.603159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8751e779-2e12-49c5-914f-258ce1bb6bf0 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 404 len: 111 microversion: 2.1 time: 0.032466 Jun 02 13:44:18.603159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 500/1025] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:18 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:18.610113 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-94f9abbe-361f-4d07-ae9a-97a5a3ff94f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '.version_select at 0x7f8614d9da60>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:18.633455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-94f9abbe-361f-4d07-ae9a-97a5a3ff94f8 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-918455951" status: 202 len: 0 microversion: 2.1 time: 0.025691 Jun 02 13:44:18.635324 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 526/1026] 10.222.0.32 () {58 vars in 1217 bytes} [Thu Jun 2 13:44:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-918455951 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:44:19.630953 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-94ec028a-01ba-46e1-9dfa-774539d5bc19 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] Action: 'create', calling method: .version_select at 0x7f8614ffcee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1104739419", "metadata": {"Type": "work"}}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:19.955509 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-94ec028a-01ba-46e1-9dfa-774539d5bc19 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.439444 Jun 02 13:44:19.956341 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 501/1027] 10.222.0.32 () {60 vars in 1155 bytes} [Thu Jun 2 13:44:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 441 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 13:44:19.968163 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b309d71f-560b-41ca-9103-9917056fdc6d tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] Calling method '.version_select at 0x7f86151d4310>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:20.025357 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b309d71f-560b-41ca-9103-9917056fdc6d tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a" status: 200 len: 353 microversion: 2.1 time: 0.061947 Jun 02 13:44:20.026098 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 527/1028] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:19 2022] GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:21.039305 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-82a035e4-0ba2-4e03-827a-38ede6e76a5b tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] Calling method '.version_select at 0x7f86151b9310>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:21.088895 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-82a035e4-0ba2-4e03-827a-38ede6e76a5b tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a" status: 200 len: 354 microversion: 2.1 time: 0.053555 Jun 02 13:44:21.090235 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 502/1029] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:21 2022] GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:21.105407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-07cfe39f-e952-4488-987f-c82553533218 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] Calling method '.version_select at 0x7f8614e5f160>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:21.159019 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-07cfe39f-e952-4488-987f-c82553533218 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a" status: 200 len: 354 microversion: 2.1 time: 0.061026 Jun 02 13:44:21.165124 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 528/1030] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:21 2022] GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:44:21.180177 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fecee7e9-1ef5-47f7-b53c-6cb44bb0a042 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] Calling method '.version_select at 0x7f861515df70>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:21.243867 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fecee7e9-1ef5-47f7-b53c-6cb44bb0a042 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a" status: 202 len: 0 microversion: 2.1 time: 0.070678 Jun 02 13:44:21.244612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 503/1031] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Jun 2 13:44:21 2022] DELETE /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:44:21.253374 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-adbfe59d-a733-4d98-8cce-9f7ba12b0d75 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] Calling method '.version_select at 0x7f86151d4040>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:21.302644 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-adbfe59d-a733-4d98-8cce-9f7ba12b0d75 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a" status: 200 len: 353 microversion: 2.1 time: 0.053032 Jun 02 13:44:21.303485 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 529/1032] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:21 2022] GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:21.585537 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b3d14aff-176c-4c96-9eff-c51a5b2550c6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:21.586150 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b3d14aff-176c-4c96-9eff-c51a5b2550c6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:21.592938 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3d14aff-176c-4c96-9eff-c51a5b2550c6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:21.593705 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3d14aff-176c-4c96-9eff-c51a5b2550c6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:21.594515 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3d14aff-176c-4c96-9eff-c51a5b2550c6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:21.595122 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3d14aff-176c-4c96-9eff-c51a5b2550c6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:21.609049 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-b3d14aff-176c-4c96-9eff-c51a5b2550c6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] HTTP exception thrown: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b3d14aff-176c-4c96-9eff-c51a5b2550c6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Request method failure captured: Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb HTTP/1.1 Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzbigMGsV69hp-9UjsF2kBzz18OMivkkIlocYD4sWJYe58ggsVEjRBn1ecTO5KNSsRz3XbHDQIcs5LfBS1Rz4pR07rIuYImr1CYCqmFJNgP4tSXx9OlAHJEwyZLgZqZ6gBzF9s_qkQ2T8L1xzLG31hoE5TTSHCiCbhJw0eCIlBGOGw Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:21.610593 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}] Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 4e88422338024035b5c64d2788965086 Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:21.612255 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': 'feaca659-ff17-4177-bb50-c7475b2d2beb'} Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:21.613087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:21.614328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:21.615581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b3d14aff-176c-4c96-9eff-c51a5b2550c6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Returning 404 to user: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:21.615581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b3d14aff-176c-4c96-9eff-c51a5b2550c6 tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "DELETE /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 404 len: 111 microversion: 2.1 time: 0.031064 Jun 02 13:44:21.615581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 504/1033] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:44:21 2022] DELETE /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:21.620872 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7202b008-b95b-4a65-b056-d941c4c46e9b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:21.621483 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7202b008-b95b-4a65-b056-d941c4c46e9b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: feaca659-ff17-4177-bb50-c7475b2d2beb] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:21.628108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7202b008-b95b-4a65-b056-d941c4c46e9b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:21.628265 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7202b008-b95b-4a65-b056-d941c4c46e9b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:21.628935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7202b008-b95b-4a65-b056-d941c4c46e9b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:21.629378 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7202b008-b95b-4a65-b056-d941c4c46e9b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:21.643993 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-7202b008-b95b-4a65-b056-d941c4c46e9b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] HTTP exception thrown: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7202b008-b95b-4a65-b056-d941c4c46e9b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Request method failure captured: Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb HTTP/1.1 Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzbigMGsV69hp-9UjsF2kBzz18OMivkkIlocYD4sWJYe58ggsVEjRBn1ecTO5KNSsRz3XbHDQIcs5LfBS1Rz4pR07rIuYImr1CYCqmFJNgP4tSXx9OlAHJEwyZLgZqZ6gBzF9s_qkQ2T8L1xzLG31hoE5TTSHCiCbhJw0eCIlBGOGw Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:21.645672 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}] Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 4e88422338024035b5c64d2788965086 Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:21.647047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'feaca659-ff17-4177-bb50-c7475b2d2beb'} Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:21.647947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. Jun 02 13:44:21.649214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:21.650328 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7202b008-b95b-4a65-b056-d941c4c46e9b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Returning 404 to user: Instance feaca659-ff17-4177-bb50-c7475b2d2beb could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:21.650328 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7202b008-b95b-4a65-b056-d941c4c46e9b tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb" status: 404 len: 111 microversion: 2.1 time: 0.030495 Jun 02 13:44:21.650492 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 530/1034] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:21 2022] GET /compute/v2.1/servers/feaca659-ff17-4177-bb50-c7475b2d2beb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:22.230406 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-797bcab3-ec73-45d2-8634-6c0c2b3e6c37 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:22.230949 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-797bcab3-ec73-45d2-8634-6c0c2b3e6c37 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:22.237673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-797bcab3-ec73-45d2-8634-6c0c2b3e6c37 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:22.238203 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-797bcab3-ec73-45d2-8634-6c0c2b3e6c37 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:22.239051 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-797bcab3-ec73-45d2-8634-6c0c2b3e6c37 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:22.239583 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-797bcab3-ec73-45d2-8634-6c0c2b3e6c37 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:22.315010 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-14e6c1bb-0532-4f52-a57d-77b27accdfb3 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] Calling method '.version_select at 0x7f8614da8310>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:22.332615 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-797bcab3-ec73-45d2-8634-6c0c2b3e6c37 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lazy-loading 'services' on Instance uuid fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:44:22.349682 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-14e6c1bb-0532-4f52-a57d-77b27accdfb3 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] HTTP exception thrown: Volume f09febf0-9d26-41b5-a567-c6fff920036a could not be found. Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-14e6c1bb-0532-4f52-a57d-77b27accdfb3 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] Request method failure captured: Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a HTTP/1.1 Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimL6zct_be30gBxXn_yJAO4trXUGsLo7HoAR8fSfuOtBhdATU6pZvP9bCBfgA00sHtcxOMkToFD4fYV-bO9s6v4GqbOrJdFlDb5993c1GfV_bJj9mqu1YWKykMzm_6SkmqMPVj-cLD77mknMw4CSeg5_xSr9lsQUoPFeta8JjUkSyans Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: c79cb057f7e4470faf76deb8d9b12dcf Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesGetTestJSON-1698828744 Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:22.352175 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c79cb057f7e4470faf76deb8d9b12dcf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c79cb057f7e4470faf76deb8d9b12dcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c79cb057f7e4470faf76deb8d9b12dcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c79cb057f7e4470faf76deb8d9b12dcf"}]}] Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesGetTestJSON-1698828744 Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: c79cb057f7e4470faf76deb8d9b12dcf Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesGetTestJSON-1698828744 Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesGetTestJSON-1698828744-project Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: b27a9ac8ea0c4f6ea438a6cd252053fd Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesGetTestJSON-1698828744-project Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Volume f09febf0-9d26-41b5-a567-c6fff920036a could not be found. Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'f09febf0-9d26-41b5-a567-c6fff920036a'} Jun 02 13:44:22.353723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f09febf0-9d26-41b5-a567-c6fff920036a could not be found. (HTTP 404) (Request-ID: req-ba24d2e4-0c24-47af-a03f-6ebe69c21487) Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:22.354641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:44:22.356773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f09febf0-9d26-41b5-a567-c6fff920036a could not be found. Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 13:44:22.358323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f09febf0-9d26-41b5-a567-c6fff920036a could not be found. Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f09febf0-9d26-41b5-a567-c6fff920036a could not be found. Jun 02 13:44:22.359777 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.364017 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-14e6c1bb-0532-4f52-a57d-77b27accdfb3 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] Returning 404 to user: Volume f09febf0-9d26-41b5-a567-c6fff920036a could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:22.364017 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-14e6c1bb-0532-4f52-a57d-77b27accdfb3 tempest-VolumesGetTestJSON-1698828744 tempest-VolumesGetTestJSON-1698828744-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a" status: 404 len: 109 microversion: 2.1 time: 0.052258 Jun 02 13:44:22.364017 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 531/1035] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:22 2022] GET /compute/v2.1/os-volumes/f09febf0-9d26-41b5-a567-c6fff920036a => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:44:22.431963 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-797bcab3-ec73-45d2-8634-6c0c2b3e6c37 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54/os-volume_attachments/7e0dc90c-f387-48e3-bdb3-402f5cbd8c84" status: 202 len: 0 microversion: 2.1 time: 0.205854 Jun 02 13:44:22.433972 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 505/1036] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:44:22 2022] DELETE /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54/os-volume_attachments/7e0dc90c-f387-48e3-bdb3-402f5cbd8c84 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:44:22.783214 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c15714e6-9816-4870-a8fb-e92680582a4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:22.783716 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c15714e6-9816-4870-a8fb-e92680582a4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:22.785898 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:22.792149 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c15714e6-9816-4870-a8fb-e92680582a4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:22.792629 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c15714e6-9816-4870-a8fb-e92680582a4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:22.793409 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c15714e6-9816-4870-a8fb-e92680582a4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:22.793849 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c15714e6-9816-4870-a8fb-e92680582a4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:22.808885 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-c15714e6-9816-4870-a8fb-e92680582a4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] HTTP exception thrown: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c15714e6-9816-4870-a8fb-e92680582a4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Request method failure captured: Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef HTTP/1.1 Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimLzbigMGsV69hp-9UjsF2kBzz18OMivkkIlocYD4sWJYe58ggsVEjRBn1ecTO5KNSsRz3XbHDQIcs5LfBS1Rz4pR07rIuYImr1CYCqmFJNgP4tSXx9OlAHJEwyZLgZqZ6gBzF9s_qkQ2T8L1xzLG31hoE5TTSHCiCbhJw0eCIlBGOGw Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:22.810446 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}] Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 4e88422338024035b5c64d2788965086 Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:44:22.811799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '50ef14f4-ad83-4f47-bcf7-cd051e84dcef'} Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:22.812578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:44:22.813926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.815598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c15714e6-9816-4870-a8fb-e92680582a4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Returning 404 to user: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:22.815598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c15714e6-9816-4870-a8fb-e92680582a4f tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "DELETE /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 404 len: 111 microversion: 2.1 time: 0.034283 Jun 02 13:44:22.815598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 532/1037] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:44:22 2022] DELETE /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:22.820812 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ad051abd-a414-47d4-bbf0-e60bae28c5cf tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:22.821519 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ad051abd-a414-47d4-bbf0-e60bae28c5cf tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] [instance: 50ef14f4-ad83-4f47-bcf7-cd051e84dcef] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:22.829482 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad051abd-a414-47d4-bbf0-e60bae28c5cf tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:22.829933 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad051abd-a414-47d4-bbf0-e60bae28c5cf tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:22.830736 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad051abd-a414-47d4-bbf0-e60bae28c5cf tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:22.831171 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad051abd-a414-47d4-bbf0-e60bae28c5cf tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:22.845660 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-ad051abd-a414-47d4-bbf0-e60bae28c5cf tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] HTTP exception thrown: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ad051abd-a414-47d4-bbf0-e60bae28c5cf tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Request method failure captured: Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef HTTP/1.1 Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimLzbigMGsV69hp-9UjsF2kBzz18OMivkkIlocYD4sWJYe58ggsVEjRBn1ecTO5KNSsRz3XbHDQIcs5LfBS1Rz4pR07rIuYImr1CYCqmFJNgP4tSXx9OlAHJEwyZLgZqZ6gBzF9s_qkQ2T8L1xzLG31hoE5TTSHCiCbhJw0eCIlBGOGw Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:22.847215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/39255fa001f44b29a23006adf9c1a10d"}]}] Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 39255fa001f44b29a23006adf9c1a10d Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1713969352 Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 4e88422338024035b5c64d2788965086 Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeTestJSON-1713969352-project Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:44:22.848674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '50ef14f4-ad83-4f47-bcf7-cd051e84dcef'} Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:22.849533 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. Jun 02 13:44:22.850764 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:22.851884 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ad051abd-a414-47d4-bbf0-e60bae28c5cf tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] Returning 404 to user: Instance 50ef14f4-ad83-4f47-bcf7-cd051e84dcef could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:22.851884 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ad051abd-a414-47d4-bbf0-e60bae28c5cf tempest-AttachVolumeTestJSON-1713969352 tempest-AttachVolumeTestJSON-1713969352-project] 10.222.0.32 "GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef" status: 404 len: 111 microversion: 2.1 time: 0.032065 Jun 02 13:44:22.852610 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 506/1038] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:22 2022] GET /compute/v2.1/servers/50ef14f4-ad83-4f47-bcf7-cd051e84dcef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:23.581198 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8e7377aa-fb09-4f3f-8ba4-6e514e99c7f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:23.581910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8e7377aa-fb09-4f3f-8ba4-6e514e99c7f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:23.594507 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e7377aa-fb09-4f3f-8ba4-6e514e99c7f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:23.595804 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e7377aa-fb09-4f3f-8ba4-6e514e99c7f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:23.598060 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e7377aa-fb09-4f3f-8ba4-6e514e99c7f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:23.599768 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e7377aa-fb09-4f3f-8ba4-6e514e99c7f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:23.679353 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8e7377aa-fb09-4f3f-8ba4-6e514e99c7f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:44:23.805350 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8e7377aa-fb09-4f3f-8ba4-6e514e99c7f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 204 len: 0 microversion: 2.1 time: 0.228487 Jun 02 13:44:23.807192 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 533/1039] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:44:23 2022] DELETE /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 02 13:44:23.816727 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bdedb51e-77b9-4ea9-97a1-70c37649b5d9 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:23.818156 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bdedb51e-77b9-4ea9-97a1-70c37649b5d9 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:23.826541 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bdedb51e-77b9-4ea9-97a1-70c37649b5d9 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:23.827648 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bdedb51e-77b9-4ea9-97a1-70c37649b5d9 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:23.829094 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bdedb51e-77b9-4ea9-97a1-70c37649b5d9 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:23.829766 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bdedb51e-77b9-4ea9-97a1-70c37649b5d9 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:24.050341 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bdedb51e-77b9-4ea9-97a1-70c37649b5d9 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:24.058356 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bdedb51e-77b9-4ea9-97a1-70c37649b5d9 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1514 microversion: 2.1 time: 0.247103 Jun 02 13:44:24.059225 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 507/1040] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:23 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:25.077215 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d2f63081-590c-4a37-8511-92addf7584ef tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:25.079463 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d2f63081-590c-4a37-8511-92addf7584ef tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:25.092643 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2f63081-590c-4a37-8511-92addf7584ef tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:25.093095 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2f63081-590c-4a37-8511-92addf7584ef tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:25.095174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2f63081-590c-4a37-8511-92addf7584ef tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:25.095803 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2f63081-590c-4a37-8511-92addf7584ef tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:25.383620 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d2f63081-590c-4a37-8511-92addf7584ef tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:25.394966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d2f63081-590c-4a37-8511-92addf7584ef tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1514 microversion: 2.1 time: 0.323318 Jun 02 13:44:25.397383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 534/1041] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:25 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1514 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:26.412488 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-988a771e-5934-40fe-823f-3c6bb2936a52 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:26.413765 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-988a771e-5934-40fe-823f-3c6bb2936a52 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:26.420924 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-988a771e-5934-40fe-823f-3c6bb2936a52 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:26.421688 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-988a771e-5934-40fe-823f-3c6bb2936a52 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:26.422482 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-988a771e-5934-40fe-823f-3c6bb2936a52 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:26.423076 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-988a771e-5934-40fe-823f-3c6bb2936a52 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:26.962495 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-988a771e-5934-40fe-823f-3c6bb2936a52 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:26.993267 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-988a771e-5934-40fe-823f-3c6bb2936a52 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1514 microversion: 2.1 time: 0.584351 Jun 02 13:44:26.995762 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 508/1042] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:26 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1514 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:27.097538 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cc413da4-41bf-4815-97c4-dcb9d6e514c2 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:27.099418 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cc413da4-41bf-4815-97c4-dcb9d6e514c2 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:27.131981 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc413da4-41bf-4815-97c4-dcb9d6e514c2 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:27.132455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc413da4-41bf-4815-97c4-dcb9d6e514c2 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:27.133263 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc413da4-41bf-4815-97c4-dcb9d6e514c2 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:27.135475 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc413da4-41bf-4815-97c4-dcb9d6e514c2 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:27.139180 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-135ff058-d724-4af8-8bd1-6183e373d4cb req-77d65770-d14d-409e-a5ca-8ccea6879367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38561783-c8ae-4094-b4c9-419507739f61", "tag": "f47de7fb-cfb6-4f5f-969c-a30939da7bf0"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:27.154883 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-135ff058-d724-4af8-8bd1-6183e373d4cb req-77d65770-d14d-409e-a5ca-8ccea6879367 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:27.155629 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-135ff058-d724-4af8-8bd1-6183e373d4cb req-77d65770-d14d-409e-a5ca-8ccea6879367 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:27.192243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-135ff058-d724-4af8-8bd1-6183e373d4cb req-77d65770-d14d-409e-a5ca-8ccea6879367 service nova] Creating event network-changed:f47de7fb-cfb6-4f5f-969c-a30939da7bf0 for instance 38561783-c8ae-4094-b4c9-419507739f61 on hv-cinder-83608 Jun 02 13:44:27.201310 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cc413da4-41bf-4815-97c4-dcb9d6e514c2 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:44:27.201887 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-135ff058-d724-4af8-8bd1-6183e373d4cb req-77d65770-d14d-409e-a5ca-8ccea6879367 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068383 Jun 02 13:44:27.207417 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 509/1043] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:44:27.413896 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cc413da4-41bf-4815-97c4-dcb9d6e514c2 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "DELETE /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 204 len: 0 microversion: 2.1 time: 0.320480 Jun 02 13:44:27.416405 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 535/1044] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:44:27 2022] DELETE /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:44:27.431931 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-85c6d806-9e09-4e37-b974-b401fd14709f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:27.435661 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-85c6d806-9e09-4e37-b974-b401fd14709f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:27.447508 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85c6d806-9e09-4e37-b974-b401fd14709f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:27.448178 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85c6d806-9e09-4e37-b974-b401fd14709f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:27.449146 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85c6d806-9e09-4e37-b974-b401fd14709f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:27.449835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85c6d806-9e09-4e37-b974-b401fd14709f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:27.657775 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-85c6d806-9e09-4e37-b974-b401fd14709f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:27.667652 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-85c6d806-9e09-4e37-b974-b401fd14709f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.241463 Jun 02 13:44:27.677866 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 510/1045] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:27 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:28.012632 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:28.012794 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:28.019122 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:28.019763 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:28.021013 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:28.021465 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:28.056350 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:28.056828 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:28.057546 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lazy-loading 'fault' on Instance uuid fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:44:28.105275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:28.113040 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-13c0df31-a752-4bc9-a20f-78a74ea93082 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1308 microversion: 2.1 time: 0.105715 Jun 02 13:44:28.113800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 536/1046] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:28 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:28.606893 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-65c99dcb-6123-42d9-8d81-713ae19f86f8 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Action: 'create', calling method: .version_select at 0x7f861514f670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-473691261"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:28.685227 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c7522ba1-2d59-48b4-9629-6e92650c8f5f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:28.685844 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c7522ba1-2d59-48b4-9629-6e92650c8f5f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:28.694589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7522ba1-2d59-48b4-9629-6e92650c8f5f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:28.694905 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7522ba1-2d59-48b4-9629-6e92650c8f5f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:28.695686 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7522ba1-2d59-48b4-9629-6e92650c8f5f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:28.696253 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7522ba1-2d59-48b4-9629-6e92650c8f5f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:28.832678 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c7522ba1-2d59-48b4-9629-6e92650c8f5f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:28.841585 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c7522ba1-2d59-48b4-9629-6e92650c8f5f tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.160724 Jun 02 13:44:28.842220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 537/1047] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:28 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:44:28.916615 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-65c99dcb-6123-42d9-8d81-713ae19f86f8 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.419909 Jun 02 13:44:28.917868 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 511/1048] 10.222.0.32 () {60 vars in 1154 bytes} [Thu Jun 2 13:44:28 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 422 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 02 13:44:28.928549 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a65357f6-e866-498a-876c-1826f70d7fd2 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f86151d4820>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:28.982861 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a65357f6-e866-498a-876c-1826f70d7fd2 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d" status: 200 len: 344 microversion: 2.1 time: 0.057949 Jun 02 13:44:28.983540 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 538/1049] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:28 2022] GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:29.129944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:29.130560 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:29.137322 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:29.137774 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:29.138531 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:29.138967 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:29.169016 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:29.169464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:29.169915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lazy-loading 'fault' on Instance uuid fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:44:29.209798 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:29.217749 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-874ead5e-7fe1-4a28-af2f-d96d8b15b198 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1308 microversion: 2.1 time: 0.091718 Jun 02 13:44:29.218306 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 512/1050] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:29 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:29.229060 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-a519171f-19dd-4f0a-a099-2fa3bff859a1 req-fb1e19b2-6ebf-4a94-8ec5-ab9c5610a5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54", "name": "network-vif-deleted", "tag": "2bc0cf5d-c91d-4aaa-8888-ed605087b6d7"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:29.237705 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-a519171f-19dd-4f0a-a099-2fa3bff859a1 req-fb1e19b2-6ebf-4a94-8ec5-ab9c5610a5d6 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:29.238154 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-a519171f-19dd-4f0a-a099-2fa3bff859a1 req-fb1e19b2-6ebf-4a94-8ec5-ab9c5610a5d6 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:29.248684 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-a519171f-19dd-4f0a-a099-2fa3bff859a1 req-fb1e19b2-6ebf-4a94-8ec5-ab9c5610a5d6 service nova] Creating event network-vif-deleted:2bc0cf5d-c91d-4aaa-8888-ed605087b6d7 for instance fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 on hv-cinder-83608 Jun 02 13:44:29.253483 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-a519171f-19dd-4f0a-a099-2fa3bff859a1 req-fb1e19b2-6ebf-4a94-8ec5-ab9c5610a5d6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028036 Jun 02 13:44:29.254042 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 539/1051] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:29.858601 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0199fb44-d251-43e9-8439-993591ef06be tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:29.859229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0199fb44-d251-43e9-8439-993591ef06be tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:29.865532 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0199fb44-d251-43e9-8439-993591ef06be tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:29.865984 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0199fb44-d251-43e9-8439-993591ef06be tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:29.866746 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0199fb44-d251-43e9-8439-993591ef06be tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:29.867186 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0199fb44-d251-43e9-8439-993591ef06be tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:29.883505 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:29.996405 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-99e96e9a-cb76-43b3-b65d-34d3f9730b6e tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f86153cd5e0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:30.006871 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0199fb44-d251-43e9-8439-993591ef06be tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:30.024767 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0199fb44-d251-43e9-8439-993591ef06be tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.169889 Jun 02 13:44:30.025545 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 513/1052] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:29 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:30.044259 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-99e96e9a-cb76-43b3-b65d-34d3f9730b6e tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d" status: 200 len: 344 microversion: 2.1 time: 0.053009 Jun 02 13:44:30.044862 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 540/1053] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:29 2022] GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:44:30.234707 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:30.235258 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:30.241540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:30.241994 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:30.242770 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:30.243207 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:30.274114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:30.274556 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:30.275010 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lazy-loading 'fault' on Instance uuid fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:44:30.315089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:30.322354 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-068b24e1-dfe2-4946-b125-9c37c8a806a8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1308 microversion: 2.1 time: 0.091530 Jun 02 13:44:30.322966 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 514/1054] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:30 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:44:31.042345 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9779f79a-4b21-45ae-9689-dcdfef69dadb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:31.045815 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9779f79a-4b21-45ae-9689-dcdfef69dadb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:31.053572 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9779f79a-4b21-45ae-9689-dcdfef69dadb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:31.053981 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9779f79a-4b21-45ae-9689-dcdfef69dadb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:31.054859 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9779f79a-4b21-45ae-9689-dcdfef69dadb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:31.055496 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9779f79a-4b21-45ae-9689-dcdfef69dadb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:31.058570 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7fc099ae-d008-4d0e-818b-76164709de61 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f8615068040>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:31.118254 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7fc099ae-d008-4d0e-818b-76164709de61 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d" status: 200 len: 345 microversion: 2.1 time: 0.065179 Jun 02 13:44:31.120434 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 515/1055] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:31 2022] GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:44:31.136268 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0c9004b6-68ac-4a5f-9919-101e34b6b779 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Action: 'create', calling method: .version_select at 0x7f861515dc10>, body: {"snapshot": {"volume_id": "f641f487-76e6-4709-b0e7-8bd61fa6d94d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1363488429"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:31.199343 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9779f79a-4b21-45ae-9689-dcdfef69dadb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:31.207808 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9779f79a-4b21-45ae-9689-dcdfef69dadb tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1568 microversion: 2.1 time: 0.169710 Jun 02 13:44:31.208404 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 541/1056] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:31 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:31.300170 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0c9004b6-68ac-4a5f-9919-101e34b6b779 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.173959 Jun 02 13:44:31.301042 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 516/1057] 10.222.0.32 () {60 vars in 1161 bytes} [Thu Jun 2 13:44:31 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:44:31.314701 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3d4e0448-5d63-4cb0-9cdc-34171a410d6c tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f8614e4e8b0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:31.339409 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:31.340174 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:31.349160 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:31.350790 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:31.351700 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:31.356416 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:31.364773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3d4e0448-5d63-4cb0-9cdc-34171a410d6c tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d" status: 200 len: 287 microversion: 2.1 time: 0.055058 Jun 02 13:44:31.370965 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 542/1058] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Jun 2 13:44:31 2022] GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:44:31.376450 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-60d32e2b-8cd1-4df0-a211-7aa17a8907eb tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f86150ed670>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:31.394111 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:31.394576 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:31.395041 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lazy-loading 'fault' on Instance uuid fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:44:31.411511 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-60d32e2b-8cd1-4df0-a211-7aa17a8907eb tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039126 Jun 02 13:44:31.412176 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 543/1059] 10.222.0.32 () {58 vars in 1139 bytes} [Thu Jun 2 13:44:31 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:31.421656 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-62a97b40-f94c-4c57-a414-dabf04d53609 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f86153e8280>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:31.455576 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:31.456650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-62a97b40-f94c-4c57-a414-dabf04d53609 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d" status: 200 len: 287 microversion: 2.1 time: 0.038452 Jun 02 13:44:31.457426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 544/1060] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Jun 2 13:44:31 2022] GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:44:31.462839 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-610f511b-8b45-46a2-be0e-08a0bb8bdd26 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 200 len: 1308 microversion: 2.1 time: 0.127420 Jun 02 13:44:31.463393 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 517/1061] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:31 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:31.837996 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-f121c7a4-2c24-4ee6-bed1-43b9074ae66b req-8604b223-1ed8-4a51-b5d3-13f952042266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38561783-c8ae-4094-b4c9-419507739f61", "name": "network-vif-deleted", "tag": "f47de7fb-cfb6-4f5f-969c-a30939da7bf0"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:31.847299 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-f121c7a4-2c24-4ee6-bed1-43b9074ae66b req-8604b223-1ed8-4a51-b5d3-13f952042266 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:31.847685 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-f121c7a4-2c24-4ee6-bed1-43b9074ae66b req-8604b223-1ed8-4a51-b5d3-13f952042266 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:31.859419 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-f121c7a4-2c24-4ee6-bed1-43b9074ae66b req-8604b223-1ed8-4a51-b5d3-13f952042266 service nova] Creating event network-vif-deleted:f47de7fb-cfb6-4f5f-969c-a30939da7bf0 for instance 38561783-c8ae-4094-b4c9-419507739f61 on hv-cinder-83608 Jun 02 13:44:31.864129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-f121c7a4-2c24-4ee6-bed1-43b9074ae66b req-8604b223-1ed8-4a51-b5d3-13f952042266 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029964 Jun 02 13:44:31.865066 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 545/1062] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:32.227707 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-68407383-0bbf-4fcd-aeba-e998d5ddb9cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:32.229013 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-68407383-0bbf-4fcd-aeba-e998d5ddb9cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:32.236531 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68407383-0bbf-4fcd-aeba-e998d5ddb9cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:32.237398 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68407383-0bbf-4fcd-aeba-e998d5ddb9cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:32.238374 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68407383-0bbf-4fcd-aeba-e998d5ddb9cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:32.238777 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68407383-0bbf-4fcd-aeba-e998d5ddb9cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:32.346015 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-68407383-0bbf-4fcd-aeba-e998d5ddb9cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:32.354944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-68407383-0bbf-4fcd-aeba-e998d5ddb9cc tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1383 microversion: 2.1 time: 0.130837 Jun 02 13:44:32.355649 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 518/1063] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:32 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1383 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:32.470429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-404e6607-6a60-4ef6-a855-25540c6d5990 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f8614e3bee0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:32.479863 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-499949f3-d4af-434b-b34c-045aad64533a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:32.480518 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-499949f3-d4af-434b-b34c-045aad64533a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:32.486978 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-499949f3-d4af-434b-b34c-045aad64533a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:32.487657 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-499949f3-d4af-434b-b34c-045aad64533a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:32.489443 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-499949f3-d4af-434b-b34c-045aad64533a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:32.489880 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-499949f3-d4af-434b-b34c-045aad64533a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:32.502573 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-404e6607-6a60-4ef6-a855-25540c6d5990 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d" status: 200 len: 287 microversion: 2.1 time: 0.036652 Jun 02 13:44:32.503323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 546/1064] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Jun 2 13:44:32 2022] GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:32.506924 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-499949f3-d4af-434b-b34c-045aad64533a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] HTTP exception thrown: Instance fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 could not be found. Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-499949f3-d4af-434b-b34c-045aad64533a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Request method failure captured: Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 HTTP/1.1 Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimL58rfwXaxABkLiQ03ZpwnEaeTzQg-YuhB0X3YS1B2fpZezdOUVZ8dadRjR_FLra0iWlgQHZPRBO8bzisxQvbHI0iWdPuYliRq4bo7iCOYc5VETD3XQSkUnxBr6vbVNXHNMlOEr2-IztlPHyPuxbwQxfi3Dx5mXx_U-4ixBkw2QQmxY Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: aa0c8692daa04252a385888208812cf4 Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1333862557 Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:32.507043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/aa0c8692daa04252a385888208812cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_aa0c8692daa04252a385888208812cf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/aa0c8692daa04252a385888208812cf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/aa0c8692daa04252a385888208812cf4"}]}] Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesSnapshotTestJSON-1333862557 Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: aa0c8692daa04252a385888208812cf4 Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1333862557 Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesSnapshotTestJSON-1333862557-project Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 4c181d9000214ce78c5acb11ac6f6f7e Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesSnapshotTestJSON-1333862557-project Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 could not be found. Jun 02 13:44:32.508632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': 'fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54'} Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 could not be found. Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:32.509501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 could not be found. Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 could not be found. Jun 02 13:44:32.511407 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:32.512619 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-499949f3-d4af-434b-b34c-045aad64533a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Returning 404 to user: Instance fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:32.512619 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-499949f3-d4af-434b-b34c-045aad64533a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54" status: 404 len: 111 microversion: 2.1 time: 0.033579 Jun 02 13:44:32.512619 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 519/1065] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:32 2022] GET /compute/v2.1/servers/fe98ef9b-d8a8-4fd8-8ff0-9dc689b72e54 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:44:33.373161 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-16dc9487-5b67-4aba-8a61-2c85758c4b55 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:33.373778 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-16dc9487-5b67-4aba-8a61-2c85758c4b55 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:33.380494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-16dc9487-5b67-4aba-8a61-2c85758c4b55 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:33.380944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-16dc9487-5b67-4aba-8a61-2c85758c4b55 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:33.381710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-16dc9487-5b67-4aba-8a61-2c85758c4b55 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:33.382183 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-16dc9487-5b67-4aba-8a61-2c85758c4b55 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:33.444632 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-16dc9487-5b67-4aba-8a61-2c85758c4b55 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:33.452761 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-16dc9487-5b67-4aba-8a61-2c85758c4b55 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1219 microversion: 2.1 time: 0.084033 Jun 02 13:44:33.453973 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 520/1066] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:33 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:33.514690 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9883e002-50d7-4842-9f6c-f6ddc11fc924 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f861515a940>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:33.546434 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9883e002-50d7-4842-9f6c-f6ddc11fc924 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d" status: 200 len: 287 microversion: 2.1 time: 0.035962 Jun 02 13:44:33.547200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 547/1067] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Jun 2 13:44:33 2022] GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:34.469296 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-93c8503b-af62-49a8-900e-58cb99171232 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:34.470493 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-93c8503b-af62-49a8-900e-58cb99171232 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:34.477026 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93c8503b-af62-49a8-900e-58cb99171232 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:34.477484 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93c8503b-af62-49a8-900e-58cb99171232 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:34.478250 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93c8503b-af62-49a8-900e-58cb99171232 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:34.478702 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93c8503b-af62-49a8-900e-58cb99171232 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:34.544700 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-93c8503b-af62-49a8-900e-58cb99171232 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:34.552378 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-93c8503b-af62-49a8-900e-58cb99171232 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1219 microversion: 2.1 time: 0.086799 Jun 02 13:44:34.558819 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 521/1068] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:34 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:34.558996 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-97cd494b-b32b-46fb-8e15-1cb9775ffc4d tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f861a2aa820>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:34.588955 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-97cd494b-b32b-46fb-8e15-1cb9775ffc4d tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d" status: 200 len: 288 microversion: 2.1 time: 0.034810 Jun 02 13:44:34.589548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 548/1069] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Jun 2 13:44:34 2022] GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:34.599567 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-81e98801-7429-40c4-adb9-a39bb25b5c45 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f8615287310>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:34.664419 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-81e98801-7429-40c4-adb9-a39bb25b5c45 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d" status: 202 len: 0 microversion: 2.1 time: 0.065963 Jun 02 13:44:34.664419 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 522/1070] 10.222.0.32 () {58 vars in 1253 bytes} [Thu Jun 2 13:44:34 2022] DELETE /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:44:34.671192 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-60fdd6fe-1baa-48b6-bc46-493019ec2f1a tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f86150f1a60>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:34.703068 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-60fdd6fe-1baa-48b6-bc46-493019ec2f1a tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d" status: 200 len: 287 microversion: 2.1 time: 0.036127 Jun 02 13:44:34.703833 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 549/1071] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Jun 2 13:44:34 2022] GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:35.569802 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f57dd97d-6838-47f4-858b-75504a3ae220 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:35.570419 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f57dd97d-6838-47f4-858b-75504a3ae220 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:35.577378 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f57dd97d-6838-47f4-858b-75504a3ae220 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:35.577832 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f57dd97d-6838-47f4-858b-75504a3ae220 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:35.578704 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f57dd97d-6838-47f4-858b-75504a3ae220 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:35.579341 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f57dd97d-6838-47f4-858b-75504a3ae220 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:35.639360 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f57dd97d-6838-47f4-858b-75504a3ae220 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:35.646792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f57dd97d-6838-47f4-858b-75504a3ae220 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1219 microversion: 2.1 time: 0.081393 Jun 02 13:44:35.647351 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 523/1072] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:35 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:35.717621 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f99284e3-cafc-4703-91cf-f2fa3fa77986 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f8614e5f040>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:35.745910 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f99284e3-cafc-4703-91cf-f2fa3fa77986 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d" status: 200 len: 287 microversion: 2.1 time: 0.034158 Jun 02 13:44:35.746474 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 550/1073] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Jun 2 13:44:35 2022] GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:36.663563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d24969c1-5387-4153-96c1-fdcf9dce69e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:36.664181 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d24969c1-5387-4153-96c1-fdcf9dce69e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:36.671292 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d24969c1-5387-4153-96c1-fdcf9dce69e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:36.671750 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d24969c1-5387-4153-96c1-fdcf9dce69e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:36.672548 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d24969c1-5387-4153-96c1-fdcf9dce69e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:36.672989 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d24969c1-5387-4153-96c1-fdcf9dce69e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:36.736564 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d24969c1-5387-4153-96c1-fdcf9dce69e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:36.744086 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d24969c1-5387-4153-96c1-fdcf9dce69e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1219 microversion: 2.1 time: 0.084339 Jun 02 13:44:36.744702 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 524/1074] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:36 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:36.757878 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e733e95d-0f33-45b6-b855-bba09a7f4b47 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f861a2aac10>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:36.793098 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e733e95d-0f33-45b6-b855-bba09a7f4b47 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d" status: 200 len: 287 microversion: 2.1 time: 0.039338 Jun 02 13:44:36.793687 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 551/1075] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Jun 2 13:44:36 2022] GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:37.763042 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:37.763659 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:37.770663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:37.776421 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:37.776893 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:37.778035 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:37.778478 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:37.805506 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-440ceaf3-0fa2-43dc-a33d-7ad15a139cc1 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f8614e4e820>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:37.828749 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:37.829234 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:37.829692 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lazy-loading 'fault' on Instance uuid 38561783-c8ae-4094-b4c9-419507739f61 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:44:37.840853 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-440ceaf3-0fa2-43dc-a33d-7ad15a139cc1 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] HTTP exception thrown: Snapshot c530adfb-cfdb-4010-b18e-441a690a772d could not be found. Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-440ceaf3-0fa2-43dc-a33d-7ad15a139cc1 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Request method failure captured: Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d HTTP/1.1 Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimL68XJi6Pbnc3mpbFoSDPvloE-mmJS37lHiqLd_a-8A8FAztfczMxU6J6DsM_O5YlgAxuZYeDvQUmGsIgBJ9UQedPHg5bxn9T8TMIGM9gaM6ER9ozEj7bQtZeyrJi2Y1SC8v6lfikiLb7Y77uaLRBLOczSKrcyb56wo_RzeZmN8uZpM Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 62b5d156601648f9a33d4f7b302f1670 Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:37.862393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/62b5d156601648f9a33d4f7b302f1670"}]}] Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 62b5d156601648f9a33d4f7b302f1670 Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesSnapshotsTestJSON-542578929-project Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 09cd9d728c394f5aaabf238f3eaf250a Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesSnapshotsTestJSON-542578929-project Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Snapshot c530adfb-cfdb-4010-b18e-441a690a772d could not be found. Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'c530adfb-cfdb-4010-b18e-441a690a772d'} Jun 02 13:44:37.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c530adfb-cfdb-4010-b18e-441a690a772d could not be found. (HTTP 404) (Request-ID: req-8c296d25-ab79-41fb-b1ae-9444031e5ff6) Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:37.865609 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:44:37.866935 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c530adfb-cfdb-4010-b18e-441a690a772d could not be found. Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 02 13:44:37.868576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c530adfb-cfdb-4010-b18e-441a690a772d could not be found. Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c530adfb-cfdb-4010-b18e-441a690a772d could not be found. Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:37.870583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-440ceaf3-0fa2-43dc-a33d-7ad15a139cc1 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Returning 404 to user: Snapshot c530adfb-cfdb-4010-b18e-441a690a772d could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:37.872393 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-440ceaf3-0fa2-43dc-a33d-7ad15a139cc1 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d" status: 404 len: 111 microversion: 2.1 time: 0.068543 Jun 02 13:44:37.873341 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 552/1076] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Jun 2 13:44:37 2022] GET /compute/v2.1/os-snapshots/c530adfb-cfdb-4010-b18e-441a690a772d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 13:44:37.882343 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c1548c0d-0c90-43f9-b0b3-3fd1bb37ff23 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f8614d9d670>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:37.908265 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02eb6e337f9a4bf5992b8668a6f0fa3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba31334d858a4e698ac0f8fc2e846895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:37.924532 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d30376c9-d8a1-424a-899f-ec57127842e7 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 200 len: 1224 microversion: 2.1 time: 0.165214 Jun 02 13:44:37.925364 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 525/1077] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:37 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 1224 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:37.981319 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c1548c0d-0c90-43f9-b0b3-3fd1bb37ff23 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d" status: 202 len: 0 microversion: 2.1 time: 0.103104 Jun 02 13:44:37.982682 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 553/1078] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Jun 2 13:44:37 2022] DELETE /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:44:37.991933 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cb57b64e-7e36-4430-be70-bd994fd4b6b2 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f8614ffcca0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:38.050180 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cb57b64e-7e36-4430-be70-bd994fd4b6b2 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d" status: 200 len: 344 microversion: 2.1 time: 0.063174 Jun 02 13:44:38.050745 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 526/1079] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:37 2022] GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:38.945477 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b9664a05-e04c-462f-8191-2fd9433f4df8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:38.947454 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b9664a05-e04c-462f-8191-2fd9433f4df8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] [instance: 38561783-c8ae-4094-b4c9-419507739f61] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:38.956689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9664a05-e04c-462f-8191-2fd9433f4df8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:38.957328 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9664a05-e04c-462f-8191-2fd9433f4df8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:38.958101 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9664a05-e04c-462f-8191-2fd9433f4df8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:38.959110 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9664a05-e04c-462f-8191-2fd9433f4df8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:38.978490 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-b9664a05-e04c-462f-8191-2fd9433f4df8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] HTTP exception thrown: Instance 38561783-c8ae-4094-b4c9-419507739f61 could not be found. Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b9664a05-e04c-462f-8191-2fd9433f4df8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Request method failure captured: Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 HTTP/1.1 Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimL1ZZPQXJD6FIOTFvCMGlOFqkv3I8tc1f9DSk-MfQ3Zs0OjEfg1pRo7sJQQuGXorRegZmUnclva3tBtYy2B0mItvYeF34QAK-SQA0wasU8fNuD5xI3tkJDY6odl3HCvCewLQPCWyW-YaIC7TRxuC1LeJt39qA48QUlt-NMtMMcBi09k Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: ba31334d858a4e698ac0f8fc2e846895 Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-TestShelveInstance-1533069753 Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:38.980032 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/ba31334d858a4e698ac0f8fc2e846895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_ba31334d858a4e698ac0f8fc2e846895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ba31334d858a4e698ac0f8fc2e846895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/ba31334d858a4e698ac0f8fc2e846895"}]}] Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-TestShelveInstance-1533069753 Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: ba31334d858a4e698ac0f8fc2e846895 Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-TestShelveInstance-1533069753 Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-TestShelveInstance-1533069753-project Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 02eb6e337f9a4bf5992b8668a6f0fa3a Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-TestShelveInstance-1533069753-project Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance 38561783-c8ae-4094-b4c9-419507739f61 could not be found. Jun 02 13:44:38.981673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': '38561783-c8ae-4094-b4c9-419507739f61'} Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38561783-c8ae-4094-b4c9-419507739f61 could not be found. Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:38.982800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38561783-c8ae-4094-b4c9-419507739f61 could not be found. Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38561783-c8ae-4094-b4c9-419507739f61 could not be found. Jun 02 13:44:38.984427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:38.986317 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b9664a05-e04c-462f-8191-2fd9433f4df8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Returning 404 to user: Instance 38561783-c8ae-4094-b4c9-419507739f61 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:38.986317 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b9664a05-e04c-462f-8191-2fd9433f4df8 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61" status: 404 len: 111 microversion: 2.1 time: 0.042490 Jun 02 13:44:38.986317 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 554/1080] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:38 2022] GET /compute/v2.1/servers/38561783-c8ae-4094-b4c9-419507739f61 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:39.065017 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-181afe05-6872-4c45-9472-6f4b3fbec87d tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f861a24eb80>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:39.105329 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-181afe05-6872-4c45-9472-6f4b3fbec87d tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] HTTP exception thrown: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-181afe05-6872-4c45-9472-6f4b3fbec87d tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Request method failure captured: Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d HTTP/1.1 Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimL68XJi6Pbnc3mpbFoSDPvloE-mmJS37lHiqLd_a-8A8FAztfczMxU6J6DsM_O5YlgAxuZYeDvQUmGsIgBJ9UQedPHg5bxn9T8TMIGM9gaM6ER9ozEj7bQtZeyrJi2Y1SC8v6lfikiLb7Y77uaLRBLOczSKrcyb56wo_RzeZmN8uZpM Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 62b5d156601648f9a33d4f7b302f1670 Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:39.113447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/62b5d156601648f9a33d4f7b302f1670"}]}] Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 62b5d156601648f9a33d4f7b302f1670 Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesSnapshotsTestJSON-542578929-project Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 09cd9d728c394f5aaabf238f3eaf250a Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesSnapshotsTestJSON-542578929-project Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': 'f641f487-76e6-4709-b0e7-8bd61fa6d94d'} Jun 02 13:44:39.115053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. (HTTP 404) (Request-ID: req-456e3262-7665-4dec-9be4-4400a1b05c22) Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:39.115944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:44:39.117550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 13:44:39.118988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-181afe05-6872-4c45-9472-6f4b3fbec87d tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Returning 404 to user: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-181afe05-6872-4c45-9472-6f4b3fbec87d tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d" status: 404 len: 109 microversion: 2.1 time: 0.055967 Jun 02 13:44:39.120993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 527/1081] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:39 2022] GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:39.134612 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0cb34af1-f041-4176-89ab-63fa35e7ff05 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f8614e5f160>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:39.184278 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-0cb34af1-f041-4176-89ab-63fa35e7ff05 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] HTTP exception thrown: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0cb34af1-f041-4176-89ab-63fa35e7ff05 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Request method failure captured: Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d HTTP/1.1 Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimL68XJi6Pbnc3mpbFoSDPvloE-mmJS37lHiqLd_a-8A8FAztfczMxU6J6DsM_O5YlgAxuZYeDvQUmGsIgBJ9UQedPHg5bxn9T8TMIGM9gaM6ER9ozEj7bQtZeyrJi2Y1SC8v6lfikiLb7Y77uaLRBLOczSKrcyb56wo_RzeZmN8uZpM Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 62b5d156601648f9a33d4f7b302f1670 Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:44:39.187819 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/62b5d156601648f9a33d4f7b302f1670"}]}] Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 62b5d156601648f9a33d4f7b302f1670 Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesSnapshotsTestJSON-542578929-project Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 09cd9d728c394f5aaabf238f3eaf250a Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesSnapshotsTestJSON-542578929-project Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'f641f487-76e6-4709-b0e7-8bd61fa6d94d'} Jun 02 13:44:39.189655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. (HTTP 404) (Request-ID: req-5bb7b986-e94e-4779-a0f4-6ec81390412e) Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:39.191008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 13:44:39.192429 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 13:44:39.194298 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0cb34af1-f041-4176-89ab-63fa35e7ff05 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Returning 404 to user: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0cb34af1-f041-4176-89ab-63fa35e7ff05 tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d" status: 404 len: 109 microversion: 2.1 time: 0.064161 Jun 02 13:44:39.197578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 555/1082] 10.222.0.32 () {58 vars in 1247 bytes} [Thu Jun 2 13:44:39 2022] DELETE /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:39.213486 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b40c6c2-5759-4f9c-a8ba-b66c1439acaa tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Calling method '.version_select at 0x7f8615308550>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:39.232057 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c41f5756-ac4a-464c-bb82-71051edf3b15 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] Calling method '.version_select at 0x7f861a2919d0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:39.272882 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c41f5756-ac4a-464c-bb82-71051edf3b15 tempest-TestShelveInstance-1533069753 tempest-TestShelveInstance-1533069753-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-346117521" status: 202 len: 0 microversion: 2.1 time: 0.044436 Jun 02 13:44:39.274003 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 556/1083] 10.222.0.32 () {58 vars in 1250 bytes} [Thu Jun 2 13:44:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-346117521 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 13:44:39.303687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-9b40c6c2-5759-4f9c-a8ba-b66c1439acaa tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] HTTP exception thrown: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b40c6c2-5759-4f9c-a8ba-b66c1439acaa tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Request method failure captured: Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d HTTP/1.1 Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimL68XJi6Pbnc3mpbFoSDPvloE-mmJS37lHiqLd_a-8A8FAztfczMxU6J6DsM_O5YlgAxuZYeDvQUmGsIgBJ9UQedPHg5bxn9T8TMIGM9gaM6ER9ozEj7bQtZeyrJi2Y1SC8v6lfikiLb7Y77uaLRBLOczSKrcyb56wo_RzeZmN8uZpM Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 62b5d156601648f9a33d4f7b302f1670 Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:44:39.308591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/62b5d156601648f9a33d4f7b302f1670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/62b5d156601648f9a33d4f7b302f1670"}]}] Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 62b5d156601648f9a33d4f7b302f1670 Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-542578929 Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesSnapshotsTestJSON-542578929-project Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 09cd9d728c394f5aaabf238f3eaf250a Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesSnapshotsTestJSON-542578929-project Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': 'f641f487-76e6-4709-b0e7-8bd61fa6d94d'} Jun 02 13:44:39.310256 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. (HTTP 404) (Request-ID: req-154fa1db-8b64-4965-918b-646035082764) Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:39.311208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 13:44:39.315902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 13:44:39.317558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b40c6c2-5759-4f9c-a8ba-b66c1439acaa tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] Returning 404 to user: Volume f641f487-76e6-4709-b0e7-8bd61fa6d94d could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9b40c6c2-5759-4f9c-a8ba-b66c1439acaa tempest-VolumesSnapshotsTestJSON-542578929 tempest-VolumesSnapshotsTestJSON-542578929-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d" status: 404 len: 109 microversion: 2.1 time: 0.107274 Jun 02 13:44:39.319910 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 528/1084] 10.222.0.32 () {58 vars in 1244 bytes} [Thu Jun 2 13:44:39 2022] GET /compute/v2.1/os-volumes/f641f487-76e6-4709-b0e7-8bd61fa6d94d => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:44:42.857168 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-553585410", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452", "networks": [{"uuid": "10c1d284-3a29-4b9e-ab99-28b1ea991f3e"}]}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:42.944806 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] validate_networks() for [('10c1d284-3a29-4b9e-ab99-28b1ea991f3e', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:44:43.537238 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:44:43.537773 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:44:43.538332 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:44:43.538854 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:44:43.539345 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:44:43.552435 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:43.553049 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:43.554088 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:43.554760 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:43.580178 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Getting quotas for project aa0c8692daa04252a385888208812cf4. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:44:43.584884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Getting quotas for user 4c181d9000214ce78c5acb11ac6f6f7e and project aa0c8692daa04252a385888208812cf4. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:44:43.600780 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:44:43.603760 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:44:43.653097 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e4344a08-be88-47ae-9ab5-8d6b29b37f8a tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803687 Jun 02 13:44:43.654110 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 557/1085] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:44:43.664638 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9258ad9f-6d6d-48bb-adda-6279df9efdfb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:43.665404 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9258ad9f-6d6d-48bb-adda-6279df9efdfb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:43.732576 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9258ad9f-6d6d-48bb-adda-6279df9efdfb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:43.741176 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9258ad9f-6d6d-48bb-adda-6279df9efdfb tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1218 microversion: 2.1 time: 0.080980 Jun 02 13:44:43.742420 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 529/1086] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:43 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:44:44.759057 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-32919e35-5fe4-47a3-9291-924ce5f5ae16 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:44.759805 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-32919e35-5fe4-47a3-9291-924ce5f5ae16 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:44.773510 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32919e35-5fe4-47a3-9291-924ce5f5ae16 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:44.774234 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32919e35-5fe4-47a3-9291-924ce5f5ae16 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:44.775318 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32919e35-5fe4-47a3-9291-924ce5f5ae16 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:44.775926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32919e35-5fe4-47a3-9291-924ce5f5ae16 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:44.782597 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:44.926442 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-32919e35-5fe4-47a3-9291-924ce5f5ae16 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:44.944321 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-32919e35-5fe4-47a3-9291-924ce5f5ae16 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1270 microversion: 2.1 time: 0.188688 Jun 02 13:44:44.945172 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 558/1087] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:44 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:45.968182 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-07289324-845a-4d04-9393-89e88838ab1d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:45.971786 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-07289324-845a-4d04-9393-89e88838ab1d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:46.023197 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07289324-845a-4d04-9393-89e88838ab1d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:46.026229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07289324-845a-4d04-9393-89e88838ab1d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:46.030697 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07289324-845a-4d04-9393-89e88838ab1d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:46.035442 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07289324-845a-4d04-9393-89e88838ab1d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:46.218201 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-07289324-845a-4d04-9393-89e88838ab1d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:46.227687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-07289324-845a-4d04-9393-89e88838ab1d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1276 microversion: 2.1 time: 0.269065 Jun 02 13:44:46.238737 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 530/1088] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:45 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:47.245818 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0ef365e9-fb74-42cf-96e1-9fa8722282c8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:47.246434 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0ef365e9-fb74-42cf-96e1-9fa8722282c8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:47.258385 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ef365e9-fb74-42cf-96e1-9fa8722282c8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:47.259033 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ef365e9-fb74-42cf-96e1-9fa8722282c8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:47.260256 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ef365e9-fb74-42cf-96e1-9fa8722282c8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:47.261057 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0ef365e9-fb74-42cf-96e1-9fa8722282c8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:47.445746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0ef365e9-fb74-42cf-96e1-9fa8722282c8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:47.457800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0ef365e9-fb74-42cf-96e1-9fa8722282c8 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1318 microversion: 2.1 time: 0.215746 Jun 02 13:44:47.458376 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 559/1089] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:47 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:48.475948 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fa40d110-7d74-47c4-8911-a66bcae3d38d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:48.476725 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fa40d110-7d74-47c4-8911-a66bcae3d38d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:48.484019 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa40d110-7d74-47c4-8911-a66bcae3d38d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:48.484876 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa40d110-7d74-47c4-8911-a66bcae3d38d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:48.485768 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa40d110-7d74-47c4-8911-a66bcae3d38d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:48.486536 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa40d110-7d74-47c4-8911-a66bcae3d38d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:48.650686 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fa40d110-7d74-47c4-8911-a66bcae3d38d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:48.659619 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fa40d110-7d74-47c4-8911-a66bcae3d38d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1318 microversion: 2.1 time: 0.187990 Jun 02 13:44:48.660189 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 531/1090] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:48 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:49.676506 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-74747eab-eede-4657-a6a4-d8ac62686a74 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:49.677422 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-74747eab-eede-4657-a6a4-d8ac62686a74 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:49.692822 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74747eab-eede-4657-a6a4-d8ac62686a74 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:49.693285 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74747eab-eede-4657-a6a4-d8ac62686a74 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:49.694072 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74747eab-eede-4657-a6a4-d8ac62686a74 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:49.694509 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74747eab-eede-4657-a6a4-d8ac62686a74 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:49.787254 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-404f97a0-2a37-42bd-baed-ca65b2aca473 req-34d48e78-366c-4c53-b23e-0bf4b8c19941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c992a54-b554-44e8-b2ac-a0408250cb21", "tag": "29ec2df2-3513-4c18-bd0b-7f95195dfd70"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:49.808369 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-404f97a0-2a37-42bd-baed-ca65b2aca473 req-34d48e78-366c-4c53-b23e-0bf4b8c19941 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:49.809014 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-404f97a0-2a37-42bd-baed-ca65b2aca473 req-34d48e78-366c-4c53-b23e-0bf4b8c19941 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:49.821719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-404f97a0-2a37-42bd-baed-ca65b2aca473 req-34d48e78-366c-4c53-b23e-0bf4b8c19941 service nova] Creating event network-changed:29ec2df2-3513-4c18-bd0b-7f95195dfd70 for instance 4c992a54-b554-44e8-b2ac-a0408250cb21 on hv-cinder-83608 Jun 02 13:44:49.827342 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-404f97a0-2a37-42bd-baed-ca65b2aca473 req-34d48e78-366c-4c53-b23e-0bf4b8c19941 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043893 Jun 02 13:44:49.828214 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 532/1091] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:44:49.970140 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-74747eab-eede-4657-a6a4-d8ac62686a74 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:49.977660 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-74747eab-eede-4657-a6a4-d8ac62686a74 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1318 microversion: 2.1 time: 0.305211 Jun 02 13:44:49.978232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 560/1092] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:49 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:50.996422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-11dd994d-918c-444b-bc1e-0a4624b4ca23 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:50.997089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-11dd994d-918c-444b-bc1e-0a4624b4ca23 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:51.012229 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-11dd994d-918c-444b-bc1e-0a4624b4ca23 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:51.013457 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-11dd994d-918c-444b-bc1e-0a4624b4ca23 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:51.014495 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-11dd994d-918c-444b-bc1e-0a4624b4ca23 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:51.015148 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-11dd994d-918c-444b-bc1e-0a4624b4ca23 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:51.386429 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-11dd994d-918c-444b-bc1e-0a4624b4ca23 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:51.395686 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-11dd994d-918c-444b-bc1e-0a4624b4ca23 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1318 microversion: 2.1 time: 0.405069 Jun 02 13:44:51.397481 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 533/1093] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:50 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1318 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:52.412764 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a5e6dfd2-fc5f-40f6-8356-8f5a9f32b0d7 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:52.413561 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a5e6dfd2-fc5f-40f6-8356-8f5a9f32b0d7 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:52.420506 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5e6dfd2-fc5f-40f6-8356-8f5a9f32b0d7 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:52.420963 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5e6dfd2-fc5f-40f6-8356-8f5a9f32b0d7 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:52.421750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5e6dfd2-fc5f-40f6-8356-8f5a9f32b0d7 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:52.422187 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5e6dfd2-fc5f-40f6-8356-8f5a9f32b0d7 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:52.931649 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a5e6dfd2-fc5f-40f6-8356-8f5a9f32b0d7 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:52.942054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a5e6dfd2-fc5f-40f6-8356-8f5a9f32b0d7 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1318 microversion: 2.1 time: 0.533353 Jun 02 13:44:52.943501 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 561/1094] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:52 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:44:53.959720 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-408ae025-a0ee-499e-93da-bd5ff1bdf007 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:53.960369 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-408ae025-a0ee-499e-93da-bd5ff1bdf007 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:53.970591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:53.975201 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408ae025-a0ee-499e-93da-bd5ff1bdf007 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:53.975874 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408ae025-a0ee-499e-93da-bd5ff1bdf007 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:53.976914 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408ae025-a0ee-499e-93da-bd5ff1bdf007 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:53.983565 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-408ae025-a0ee-499e-93da-bd5ff1bdf007 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:54.225455 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-408ae025-a0ee-499e-93da-bd5ff1bdf007 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:54.238922 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-408ae025-a0ee-499e-93da-bd5ff1bdf007 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1318 microversion: 2.1 time: 0.283718 Jun 02 13:44:54.248869 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 534/1095] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:53 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:55.259906 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6369ea37-fa22-4519-b7c3-c6313a6b8ffc tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:55.261563 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6369ea37-fa22-4519-b7c3-c6313a6b8ffc tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:55.269318 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:55.270003 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=6 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:55.271002 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:55.282194 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6369ea37-fa22-4519-b7c3-c6313a6b8ffc tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:55.286008 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6369ea37-fa22-4519-b7c3-c6313a6b8ffc tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:55.287037 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6369ea37-fa22-4519-b7c3-c6313a6b8ffc tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:55.287655 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6369ea37-fa22-4519-b7c3-c6313a6b8ffc tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:55.476235 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-618d538b-666a-4bde-9cfa-8d11bd74a519 req-ce9d4706-5c5b-49c6-9eec-28f42f6c49e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c992a54-b554-44e8-b2ac-a0408250cb21", "name": "network-vif-plugged", "status": "completed", "tag": "29ec2df2-3513-4c18-bd0b-7f95195dfd70"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:55.485275 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-618d538b-666a-4bde-9cfa-8d11bd74a519 req-ce9d4706-5c5b-49c6-9eec-28f42f6c49e4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:55.486061 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-618d538b-666a-4bde-9cfa-8d11bd74a519 req-ce9d4706-5c5b-49c6-9eec-28f42f6c49e4 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:55.486995 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6369ea37-fa22-4519-b7c3-c6313a6b8ffc tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:55.499334 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-618d538b-666a-4bde-9cfa-8d11bd74a519 req-ce9d4706-5c5b-49c6-9eec-28f42f6c49e4 service nova] Creating event network-vif-plugged:29ec2df2-3513-4c18-bd0b-7f95195dfd70 for instance 4c992a54-b554-44e8-b2ac-a0408250cb21 on hv-cinder-83608 Jun 02 13:44:55.501476 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6369ea37-fa22-4519-b7c3-c6313a6b8ffc tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1318 microversion: 2.1 time: 0.247669 Jun 02 13:44:55.502065 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 562/1096] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:55 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:55.504705 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-618d538b-666a-4bde-9cfa-8d11bd74a519 req-ce9d4706-5c5b-49c6-9eec-28f42f6c49e4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033186 Jun 02 13:44:55.505782 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 535/1097] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:44:56.521740 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ddcfddf6-ca26-45ad-afe1-4c4c9ec688cf tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:56.523247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ddcfddf6-ca26-45ad-afe1-4c4c9ec688cf tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:56.546845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddcfddf6-ca26-45ad-afe1-4c4c9ec688cf tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:56.548606 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddcfddf6-ca26-45ad-afe1-4c4c9ec688cf tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:56.549618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddcfddf6-ca26-45ad-afe1-4c4c9ec688cf tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:56.550078 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddcfddf6-ca26-45ad-afe1-4c4c9ec688cf tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:56.809872 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ddcfddf6-ca26-45ad-afe1-4c4c9ec688cf tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:56.830508 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ddcfddf6-ca26-45ad-afe1-4c4c9ec688cf tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1318 microversion: 2.1 time: 0.313822 Jun 02 13:44:56.837172 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 563/1098] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:56 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:57.852485 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ce7a7437-19fd-4352-b220-6b8a19d33247 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:44:57.853823 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ce7a7437-19fd-4352-b220-6b8a19d33247 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:57.872288 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce7a7437-19fd-4352-b220-6b8a19d33247 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:57.873886 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce7a7437-19fd-4352-b220-6b8a19d33247 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:57.874856 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce7a7437-19fd-4352-b220-6b8a19d33247 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:57.875960 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce7a7437-19fd-4352-b220-6b8a19d33247 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:58.089556 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ce7a7437-19fd-4352-b220-6b8a19d33247 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:44:58.105738 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ce7a7437-19fd-4352-b220-6b8a19d33247 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1508 microversion: 2.1 time: 0.258630 Jun 02 13:44:58.107179 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 536/1099] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:44:57 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:44:58.123650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-dd40eb99-da56-4a13-8705-7dc41f9a7321 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "611495a2-040f-4aa2-85c1-9213aab37e72", "device": "/dev/sdb"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:44:58.125442 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-dd40eb99-da56-4a13-8705-7dc41f9a7321 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:44:58.133271 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd40eb99-da56-4a13-8705-7dc41f9a7321 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:58.135956 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd40eb99-da56-4a13-8705-7dc41f9a7321 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:58.136872 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd40eb99-da56-4a13-8705-7dc41f9a7321 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:44:58.138134 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dd40eb99-da56-4a13-8705-7dc41f9a7321 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:44:58.612205 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-dd40eb99-da56-4a13-8705-7dc41f9a7321 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "POST /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492845 Jun 02 13:44:58.613568 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 564/1100] 10.222.0.32 () {60 vars in 1322 bytes} [Thu Jun 2 13:44:58 2022] POST /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:45:01.767743 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d965686f-84ef-4764-ae2b-bd2e530992c0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Action: 'create', calling method: .version_select at 0x7f861a258790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1204951225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBjM13OvA14Nk1UwSoc+J1inJO/oqPqWEvQLwHW33uJyxzsfw+juSTtCnhbpFkVtbYM5Y7D+MvTkHl25Y1hbTbOETzr/77ysaNx+2JZUVmnjnwv+2ixID5wFlyJ/8YOIQ=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:01.784206 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-d965686f-84ef-4764-ae2b-bd2e530992c0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Getting quotas for project 25b312790b9644bb8fbe30d2ab637db0. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:45:01.796391 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-d965686f-84ef-4764-ae2b-bd2e530992c0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Getting quotas for user 64d281c3f8e447aaacb073ed0f8c7a35 and project 25b312790b9644bb8fbe30d2ab637db0. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:45:01.824603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d965686f-84ef-4764-ae2b-bd2e530992c0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.228000 Jun 02 13:45:01.842461 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 537/1101] 10.222.0.32 () {60 vars in 1158 bytes} [Thu Jun 2 13:45:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:22.265436 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=5 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:22.266322 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:22.270909 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-858424653", "imageRef": "0d2cc4e2-404f-4762-b8d4-72a78d67190b", "flavorRef": "452"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:22.326705 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] validate_networks() for None {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:45:22.608750 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:45:22.609220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:45:22.609860 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:45:22.610455 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:45:22.610934 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:45:22.621680 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:22.622257 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:22.623164 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:22.623602 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:22.641728 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Getting quotas for project 97425c4354ba47dc9a4a6e434a57c97e. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:45:22.645919 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Getting quotas for user 665084d472824beb91eb2f615b56ceb1 and project 97425c4354ba47dc9a4a6e434a57c97e. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:45:22.657837 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:45:22.660445 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2cc4e2-404f-4762-b8d4-72a78d67190b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:45:22.706947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-afc977b0-b88d-4c54-9a05-22267ed2348b tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.442940 Jun 02 13:45:22.707774 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 565/1102] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:45:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:45:22.715323 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=93 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:22.716094 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=4 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:22.717023 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:22.722132 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2de223c0-a5b8-4df7-8dc5-99c688744d10 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:22.722865 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2de223c0-a5b8-4df7-8dc5-99c688744d10 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:22.777388 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2de223c0-a5b8-4df7-8dc5-99c688744d10 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:22.784237 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2de223c0-a5b8-4df7-8dc5-99c688744d10 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1214 microversion: 2.1 time: 0.070179 Jun 02 13:45:22.784980 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 538/1103] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:22 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:23.403820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4d5ab41b-c4c5-4048-943f-2ac99c829b82 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:23.404986 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4d5ab41b-c4c5-4048-943f-2ac99c829b82 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:23.412079 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d5ab41b-c4c5-4048-943f-2ac99c829b82 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:23.412617 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d5ab41b-c4c5-4048-943f-2ac99c829b82 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:23.413522 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d5ab41b-c4c5-4048-943f-2ac99c829b82 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:23.413958 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4d5ab41b-c4c5-4048-943f-2ac99c829b82 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:23.495843 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-4d5ab41b-c4c5-4048-943f-2ac99c829b82 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lazy-loading 'services' on Instance uuid 4c992a54-b554-44e8-b2ac-a0408250cb21 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:45:23.565809 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4d5ab41b-c4c5-4048-943f-2ac99c829b82 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21/os-volume_attachments/611495a2-040f-4aa2-85c1-9213aab37e72" status: 202 len: 0 microversion: 2.1 time: 0.166420 Jun 02 13:45:23.566854 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 566/1104] 10.222.0.32 () {58 vars in 1415 bytes} [Thu Jun 2 13:45:23 2022] DELETE /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21/os-volume_attachments/611495a2-040f-4aa2-85c1-9213aab37e72 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:45:23.803312 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3a1880cd-51ca-4ac2-a46a-bc6562ed59ed tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:23.804136 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3a1880cd-51ca-4ac2-a46a-bc6562ed59ed tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:23.816649 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a1880cd-51ca-4ac2-a46a-bc6562ed59ed tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:23.817158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a1880cd-51ca-4ac2-a46a-bc6562ed59ed tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:23.818138 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a1880cd-51ca-4ac2-a46a-bc6562ed59ed tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:23.819011 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a1880cd-51ca-4ac2-a46a-bc6562ed59ed tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:23.879562 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1081936476", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1204951225", "security_groups": [{"name": "tempest-secgroup-smoke-286801246"}], "block_device_mapping_v2": [{"uuid": "9e5b3f6c-60bc-4569-93d2-e4ad10661d58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8baefc5e-7f63-4469-aeac-36f2a3f9fc2f"}]}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:23.892754 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a1880cd-51ca-4ac2-a46a-bc6562ed59ed tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:23.900998 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3a1880cd-51ca-4ac2-a46a-bc6562ed59ed tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1284 microversion: 2.1 time: 0.103461 Jun 02 13:45:23.902490 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 539/1105] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:23 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:24.002130 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] validate_networks() for [('8baefc5e-7f63-4469-aeac-36f2a3f9fc2f', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:45:24.575601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:45:24.576665 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:45:24.576958 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:45:24.577595 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:45:24.578328 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:45:24.588483 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:24.588932 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:24.589817 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:24.590352 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:24.609630 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Getting quotas for project 25b312790b9644bb8fbe30d2ab637db0. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:45:24.613790 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Getting quotas for user 64d281c3f8e447aaacb073ed0f8c7a35 and project 25b312790b9644bb8fbe30d2ab637db0. Resources: {'cores', 'instances', 'ram'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:45:24.726677 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:45:24.728813 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e5b3f6c-60bc-4569-93d2-e4ad10661d58',volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:45:24.747845 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3130b488-7f5a-4458-9c01-224206426f71 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:24.748381 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3130b488-7f5a-4458-9c01-224206426f71 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:24.754435 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3130b488-7f5a-4458-9c01-224206426f71 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:24.754885 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3130b488-7f5a-4458-9c01-224206426f71 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:24.755646 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3130b488-7f5a-4458-9c01-224206426f71 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:24.756081 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3130b488-7f5a-4458-9c01-224206426f71 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:24.782540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3130b488-7f5a-4458-9c01-224206426f71 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:45:24.871298 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3130b488-7f5a-4458-9c01-224206426f71 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 204 len: 0 microversion: 2.1 time: 0.126809 Jun 02 13:45:24.873723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f74ec8cc-2633-4299-baca-adb64c21c7ac tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.998664 Jun 02 13:45:24.874440 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 567/1106] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:45:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:45:24.884095 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-510da894-2a2c-404a-80dd-7dc8dfc4cb5e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:24.884746 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-510da894-2a2c-404a-80dd-7dc8dfc4cb5e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:24.887546 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 540/1107] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:45:24 2022] DELETE /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:45:24.893689 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a3738e67-a364-4577-be6b-5b7da94f0de2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:24.894623 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a3738e67-a364-4577-be6b-5b7da94f0de2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:24.897521 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-510da894-2a2c-404a-80dd-7dc8dfc4cb5e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:24.898326 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-510da894-2a2c-404a-80dd-7dc8dfc4cb5e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:24.899430 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-510da894-2a2c-404a-80dd-7dc8dfc4cb5e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:24.900280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-510da894-2a2c-404a-80dd-7dc8dfc4cb5e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:24.988038 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a3738e67-a364-4577-be6b-5b7da94f0de2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:24.995392 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a3738e67-a364-4577-be6b-5b7da94f0de2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1095 microversion: 2.1 time: 0.105781 Jun 02 13:45:24.996184 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 541/1108] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:24 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1095 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:25.014004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-08680b05-6f0d-460e-b5e0-1f1c6473ba62 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:25.017794 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-08680b05-6f0d-460e-b5e0-1f1c6473ba62 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:25.030683 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-08680b05-6f0d-460e-b5e0-1f1c6473ba62 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:25.032167 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-08680b05-6f0d-460e-b5e0-1f1c6473ba62 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:25.033249 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-08680b05-6f0d-460e-b5e0-1f1c6473ba62 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:25.037416 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-08680b05-6f0d-460e-b5e0-1f1c6473ba62 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:25.356134 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-08680b05-6f0d-460e-b5e0-1f1c6473ba62 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:25.365000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-08680b05-6f0d-460e-b5e0-1f1c6473ba62 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1272 microversion: 2.1 time: 0.367600 Jun 02 13:45:25.365581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 542/1109] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:24 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1272 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:25.438883 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-510da894-2a2c-404a-80dd-7dc8dfc4cb5e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:25.447113 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-510da894-2a2c-404a-80dd-7dc8dfc4cb5e tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1514 microversion: 2.1 time: 0.566692 Jun 02 13:45:25.447689 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 568/1110] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:24 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1514 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:26.012655 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f2dcc590-ce5f-464e-83b8-cd7d042b28e2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:26.013274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f2dcc590-ce5f-464e-83b8-cd7d042b28e2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:26.019738 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f2dcc590-ce5f-464e-83b8-cd7d042b28e2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:26.020184 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f2dcc590-ce5f-464e-83b8-cd7d042b28e2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:26.020978 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f2dcc590-ce5f-464e-83b8-cd7d042b28e2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:26.021413 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f2dcc590-ce5f-464e-83b8-cd7d042b28e2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:26.080760 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f2dcc590-ce5f-464e-83b8-cd7d042b28e2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:26.088123 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f2dcc590-ce5f-464e-83b8-cd7d042b28e2 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1145 microversion: 2.1 time: 0.079518 Jun 02 13:45:26.088719 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 543/1111] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:26 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:26.382499 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c581c0ef-87e8-466f-b723-b8ee0eeeab8c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:26.383151 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c581c0ef-87e8-466f-b723-b8ee0eeeab8c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:26.390253 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c581c0ef-87e8-466f-b723-b8ee0eeeab8c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:26.390711 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c581c0ef-87e8-466f-b723-b8ee0eeeab8c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:26.391482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c581c0ef-87e8-466f-b723-b8ee0eeeab8c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:26.391926 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c581c0ef-87e8-466f-b723-b8ee0eeeab8c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:26.465930 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b05c6ff8-a540-44a3-9e74-4afe47d829b0 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:26.467101 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b05c6ff8-a540-44a3-9e74-4afe47d829b0 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:26.477796 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b05c6ff8-a540-44a3-9e74-4afe47d829b0 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:26.478257 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b05c6ff8-a540-44a3-9e74-4afe47d829b0 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:26.479053 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b05c6ff8-a540-44a3-9e74-4afe47d829b0 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:26.479695 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b05c6ff8-a540-44a3-9e74-4afe47d829b0 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:26.701998 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c581c0ef-87e8-466f-b723-b8ee0eeeab8c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:26.711036 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c581c0ef-87e8-466f-b723-b8ee0eeeab8c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.332403 Jun 02 13:45:26.720880 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 569/1112] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:26 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:26.731223 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b05c6ff8-a540-44a3-9e74-4afe47d829b0 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:26.739471 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b05c6ff8-a540-44a3-9e74-4afe47d829b0 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1514 microversion: 2.1 time: 0.277288 Jun 02 13:45:26.740155 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 544/1113] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:26 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:27.097654 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-ec1903d3-367f-44e9-b5f8-1bdc38b02fd0 req-e85bcd05-c22a-4dd4-bebf-a97365007fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d66804-3822-44fb-ada6-af381401c74e", "tag": "ed5006ae-d241-4ca4-8eb3-1aa8e1b6ef50"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:27.104944 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-65b1bbfa-ef91-4740-ba81-3c8a34bfc072 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:27.106182 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-65b1bbfa-ef91-4740-ba81-3c8a34bfc072 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:27.108922 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-ec1903d3-367f-44e9-b5f8-1bdc38b02fd0 req-e85bcd05-c22a-4dd4-bebf-a97365007fab service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:27.109481 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-ec1903d3-367f-44e9-b5f8-1bdc38b02fd0 req-e85bcd05-c22a-4dd4-bebf-a97365007fab service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:27.114893 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65b1bbfa-ef91-4740-ba81-3c8a34bfc072 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:27.115560 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65b1bbfa-ef91-4740-ba81-3c8a34bfc072 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:27.116545 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65b1bbfa-ef91-4740-ba81-3c8a34bfc072 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:27.117199 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65b1bbfa-ef91-4740-ba81-3c8a34bfc072 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:27.131219 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-ec1903d3-367f-44e9-b5f8-1bdc38b02fd0 req-e85bcd05-c22a-4dd4-bebf-a97365007fab service nova] Creating event network-changed:ed5006ae-d241-4ca4-8eb3-1aa8e1b6ef50 for instance a4d66804-3822-44fb-ada6-af381401c74e on hv-cinder-83608 Jun 02 13:45:27.143678 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-ec1903d3-367f-44e9-b5f8-1bdc38b02fd0 req-e85bcd05-c22a-4dd4-bebf-a97365007fab service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050090 Jun 02 13:45:27.144646 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 570/1114] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:27.199979 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-65b1bbfa-ef91-4740-ba81-3c8a34bfc072 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:27.209373 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-65b1bbfa-ef91-4740-ba81-3c8a34bfc072 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1201 microversion: 2.1 time: 0.108320 Jun 02 13:45:27.210291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 545/1115] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:27 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1201 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:27.370516 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-619e396f-3c1c-41b6-9e08-d4e5287b3a4a req-60a225eb-3d20-428f-8fab-ca985068fa07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c992a54-b554-44e8-b2ac-a0408250cb21", "name": "network-vif-deleted", "tag": "29ec2df2-3513-4c18-bd0b-7f95195dfd70"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:27.379743 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-619e396f-3c1c-41b6-9e08-d4e5287b3a4a req-60a225eb-3d20-428f-8fab-ca985068fa07 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:27.380193 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-619e396f-3c1c-41b6-9e08-d4e5287b3a4a req-60a225eb-3d20-428f-8fab-ca985068fa07 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:27.390852 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-619e396f-3c1c-41b6-9e08-d4e5287b3a4a req-60a225eb-3d20-428f-8fab-ca985068fa07 service nova] Creating event network-vif-deleted:29ec2df2-3513-4c18-bd0b-7f95195dfd70 for instance 4c992a54-b554-44e8-b2ac-a0408250cb21 on hv-cinder-83608 Jun 02 13:45:27.395559 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-619e396f-3c1c-41b6-9e08-d4e5287b3a4a req-60a225eb-3d20-428f-8fab-ca985068fa07 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029141 Jun 02 13:45:27.396147 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 571/1116] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:27.728110 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6f249d85-e3b1-4387-b39f-07d3c90e3d13 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:27.728677 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6f249d85-e3b1-4387-b39f-07d3c90e3d13 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:27.735303 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f249d85-e3b1-4387-b39f-07d3c90e3d13 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:27.735763 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f249d85-e3b1-4387-b39f-07d3c90e3d13 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:27.736548 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f249d85-e3b1-4387-b39f-07d3c90e3d13 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:27.736993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f249d85-e3b1-4387-b39f-07d3c90e3d13 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:27.759568 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-01459dcf-291d-4943-8ce9-3d4b8dc4b0f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:27.760641 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-01459dcf-291d-4943-8ce9-3d4b8dc4b0f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:27.770115 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01459dcf-291d-4943-8ce9-3d4b8dc4b0f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:27.770879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01459dcf-291d-4943-8ce9-3d4b8dc4b0f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:27.771876 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01459dcf-291d-4943-8ce9-3d4b8dc4b0f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:27.772598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-01459dcf-291d-4943-8ce9-3d4b8dc4b0f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:27.851647 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-01459dcf-291d-4943-8ce9-3d4b8dc4b0f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:27.859091 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-01459dcf-291d-4943-8ce9-3d4b8dc4b0f6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1472 microversion: 2.1 time: 0.104757 Jun 02 13:45:27.859728 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 572/1117] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:27 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1472 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:27.886817 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6f249d85-e3b1-4387-b39f-07d3c90e3d13 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:27.894864 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6f249d85-e3b1-4387-b39f-07d3c90e3d13 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.170698 Jun 02 13:45:27.895413 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 546/1118] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:27 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:28.226599 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ba85dc6f-1a63-45e3-a9df-922e33862239 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:28.227204 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ba85dc6f-1a63-45e3-a9df-922e33862239 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:28.233187 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba85dc6f-1a63-45e3-a9df-922e33862239 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:28.233636 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba85dc6f-1a63-45e3-a9df-922e33862239 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:28.234395 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba85dc6f-1a63-45e3-a9df-922e33862239 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:28.234830 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ba85dc6f-1a63-45e3-a9df-922e33862239 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:28.296993 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ba85dc6f-1a63-45e3-a9df-922e33862239 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:28.304244 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ba85dc6f-1a63-45e3-a9df-922e33862239 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1201 microversion: 2.1 time: 0.081535 Jun 02 13:45:28.304909 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 573/1119] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:28 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1201 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:28.876249 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-baf032d0-5b4d-4dd5-a135-ec1642f26182 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:28.876893 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-baf032d0-5b4d-4dd5-a135-ec1642f26182 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:28.883326 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-baf032d0-5b4d-4dd5-a135-ec1642f26182 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:28.883806 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-baf032d0-5b4d-4dd5-a135-ec1642f26182 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:28.884631 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-baf032d0-5b4d-4dd5-a135-ec1642f26182 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:28.885070 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-baf032d0-5b4d-4dd5-a135-ec1642f26182 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:28.912497 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8febce0b-45c7-47db-ab81-804cb741d389 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:28.913104 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8febce0b-45c7-47db-ab81-804cb741d389 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:28.920183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8febce0b-45c7-47db-ab81-804cb741d389 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:28.920650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8febce0b-45c7-47db-ab81-804cb741d389 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:28.921414 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8febce0b-45c7-47db-ab81-804cb741d389 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:28.921850 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8febce0b-45c7-47db-ab81-804cb741d389 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:28.952152 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-baf032d0-5b4d-4dd5-a135-ec1642f26182 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:28.960510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-baf032d0-5b4d-4dd5-a135-ec1642f26182 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1472 microversion: 2.1 time: 0.088717 Jun 02 13:45:28.961159 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 547/1120] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:28 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1472 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:29.054341 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8febce0b-45c7-47db-ab81-804cb741d389 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:29.061719 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8febce0b-45c7-47db-ab81-804cb741d389 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.153034 Jun 02 13:45:29.062296 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 574/1121] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:28 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:29.321260 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-19a90466-f019-43b4-920f-30ceba7d3745 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:29.321772 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-19a90466-f019-43b4-920f-30ceba7d3745 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:29.328552 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19a90466-f019-43b4-920f-30ceba7d3745 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:29.329000 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19a90466-f019-43b4-920f-30ceba7d3745 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:29.329755 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19a90466-f019-43b4-920f-30ceba7d3745 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:29.330188 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19a90466-f019-43b4-920f-30ceba7d3745 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:29.389569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-19a90466-f019-43b4-920f-30ceba7d3745 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:29.396802 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-19a90466-f019-43b4-920f-30ceba7d3745 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1201 microversion: 2.1 time: 0.079438 Jun 02 13:45:29.397359 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 548/1122] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:29 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1201 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:29.978663 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:29.979540 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:29.990615 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:29.991742 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:29.993646 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:29.994488 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:30.052466 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:30.053242 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:30.054503 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lazy-loading 'fault' on Instance uuid 4c992a54-b554-44e8-b2ac-a0408250cb21 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:45:30.079120 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-299ebd3c-a6d4-4568-8851-aab7aee550d2 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:30.079918 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-299ebd3c-a6d4-4568-8851-aab7aee550d2 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:30.104970 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-299ebd3c-a6d4-4568-8851-aab7aee550d2 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:30.112684 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-299ebd3c-a6d4-4568-8851-aab7aee550d2 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:30.116581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-299ebd3c-a6d4-4568-8851-aab7aee550d2 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:30.117170 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-299ebd3c-a6d4-4568-8851-aab7aee550d2 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:30.138532 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c181d9000214ce78c5acb11ac6f6f7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa0c8692daa04252a385888208812cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:30.149884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cb24e7d8-cf6a-4b61-a150-f79fee7c304d tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 200 len: 1308 microversion: 2.1 time: 0.174582 Jun 02 13:45:30.152658 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 575/1123] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:29 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:30.375217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-299ebd3c-a6d4-4568-8851-aab7aee550d2 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:30.383930 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-299ebd3c-a6d4-4568-8851-aab7aee550d2 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.309378 Jun 02 13:45:30.385031 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 549/1124] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:30 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:30.414135 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bc28e972-f7b3-4da8-960f-a1489fdc1dfe tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:30.414756 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bc28e972-f7b3-4da8-960f-a1489fdc1dfe tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:30.422221 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc28e972-f7b3-4da8-960f-a1489fdc1dfe tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:30.422695 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc28e972-f7b3-4da8-960f-a1489fdc1dfe tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:30.423598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc28e972-f7b3-4da8-960f-a1489fdc1dfe tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:30.424102 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc28e972-f7b3-4da8-960f-a1489fdc1dfe tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:30.504535 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bc28e972-f7b3-4da8-960f-a1489fdc1dfe tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:30.513345 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bc28e972-f7b3-4da8-960f-a1489fdc1dfe tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1211 microversion: 2.1 time: 0.102919 Jun 02 13:45:30.522734 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 576/1125] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:30 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1211 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:31.170604 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c3fe75a9-83a1-46c3-9860-52529db951e6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:31.171230 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c3fe75a9-83a1-46c3-9860-52529db951e6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] [instance: 4c992a54-b554-44e8-b2ac-a0408250cb21] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:31.177757 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3fe75a9-83a1-46c3-9860-52529db951e6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:31.178215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3fe75a9-83a1-46c3-9860-52529db951e6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:31.178989 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3fe75a9-83a1-46c3-9860-52529db951e6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:31.179432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3fe75a9-83a1-46c3-9860-52529db951e6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:31.192795 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-c3fe75a9-83a1-46c3-9860-52529db951e6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] HTTP exception thrown: Instance 4c992a54-b554-44e8-b2ac-a0408250cb21 could not be found. Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c3fe75a9-83a1-46c3-9860-52529db951e6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Request method failure captured: Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 HTTP/1.1 Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimL58rfwXaxABkLiQ03ZpwnEaeTzQg-YuhB0X3YS1B2fpZezdOUVZ8dadRjR_FLra0iWlgQHZPRBO8bzisxQvbHI0iWdPuYliRq4bo7iCOYc5VETD3XQSkUnxBr6vbVNXHNMlOEr2-IztlPHyPuxbwQxfi3Dx5mXx_U-4ixBkw2QQmxY Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: aa0c8692daa04252a385888208812cf4 Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1333862557 Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:45:31.194422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/aa0c8692daa04252a385888208812cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_aa0c8692daa04252a385888208812cf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/aa0c8692daa04252a385888208812cf4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/aa0c8692daa04252a385888208812cf4"}]}] Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesSnapshotTestJSON-1333862557 Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: aa0c8692daa04252a385888208812cf4 Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1333862557 Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesSnapshotTestJSON-1333862557-project Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 4c181d9000214ce78c5acb11ac6f6f7e Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesSnapshotTestJSON-1333862557-project Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 4c992a54-b554-44e8-b2ac-a0408250cb21 could not be found. Jun 02 13:45:31.196216 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '4c992a54-b554-44e8-b2ac-a0408250cb21'} Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c992a54-b554-44e8-b2ac-a0408250cb21 could not be found. Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:45:31.197464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c992a54-b554-44e8-b2ac-a0408250cb21 could not be found. Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c992a54-b554-44e8-b2ac-a0408250cb21 could not be found. Jun 02 13:45:31.199004 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:45:31.200733 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c3fe75a9-83a1-46c3-9860-52529db951e6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] Returning 404 to user: Instance 4c992a54-b554-44e8-b2ac-a0408250cb21 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:45:31.200733 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c3fe75a9-83a1-46c3-9860-52529db951e6 tempest-VolumesSnapshotTestJSON-1333862557 tempest-VolumesSnapshotTestJSON-1333862557-project] 10.222.0.32 "GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21" status: 404 len: 111 microversion: 2.1 time: 0.029684 Jun 02 13:45:31.200733 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 550/1126] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:31 2022] GET /compute/v2.1/servers/4c992a54-b554-44e8-b2ac-a0408250cb21 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:45:31.401427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-670fbc32-989f-45ed-9620-af3376b82b93 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:31.402054 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-670fbc32-989f-45ed-9620-af3376b82b93 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:31.410088 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-670fbc32-989f-45ed-9620-af3376b82b93 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:31.410545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-670fbc32-989f-45ed-9620-af3376b82b93 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:31.413574 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-670fbc32-989f-45ed-9620-af3376b82b93 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:31.415353 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-670fbc32-989f-45ed-9620-af3376b82b93 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:31.534566 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4e5b4824-d761-4aaf-9799-9327aaf649a3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:31.535605 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4e5b4824-d761-4aaf-9799-9327aaf649a3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:31.542848 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e5b4824-d761-4aaf-9799-9327aaf649a3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:31.544521 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e5b4824-d761-4aaf-9799-9327aaf649a3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:31.545886 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e5b4824-d761-4aaf-9799-9327aaf649a3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:31.546569 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e5b4824-d761-4aaf-9799-9327aaf649a3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:31.657284 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-670fbc32-989f-45ed-9620-af3376b82b93 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:31.665665 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-670fbc32-989f-45ed-9620-af3376b82b93 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.268648 Jun 02 13:45:31.666438 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 577/1127] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:31 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:31.724447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4e5b4824-d761-4aaf-9799-9327aaf649a3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:31.732554 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4e5b4824-d761-4aaf-9799-9327aaf649a3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.206201 Jun 02 13:45:31.733127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 551/1128] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:31 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:32.263594 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-dcef5deb-99b0-4c92-a6ca-f9890182eb80 req-7e372e5f-2900-4c63-b815-a72bb1d2f29b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd3b9ba-53ce-42d2-a66b-a887d8011754", "tag": "3173bcbd-6b05-4587-a656-5fddd42b5298"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:32.274755 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-dcef5deb-99b0-4c92-a6ca-f9890182eb80 req-7e372e5f-2900-4c63-b815-a72bb1d2f29b service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:32.275170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-dcef5deb-99b0-4c92-a6ca-f9890182eb80 req-7e372e5f-2900-4c63-b815-a72bb1d2f29b service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:32.294479 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-dcef5deb-99b0-4c92-a6ca-f9890182eb80 req-7e372e5f-2900-4c63-b815-a72bb1d2f29b service nova] Creating event network-changed:3173bcbd-6b05-4587-a656-5fddd42b5298 for instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 on hv-cinder-83608 Jun 02 13:45:32.300276 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-dcef5deb-99b0-4c92-a6ca-f9890182eb80 req-7e372e5f-2900-4c63-b815-a72bb1d2f29b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040745 Jun 02 13:45:32.304571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 578/1129] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:32.685207 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5c2d4f90-7b12-44ea-a2eb-e641e5c9424f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:32.687108 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5c2d4f90-7b12-44ea-a2eb-e641e5c9424f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:32.696094 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c2d4f90-7b12-44ea-a2eb-e641e5c9424f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:32.697215 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c2d4f90-7b12-44ea-a2eb-e641e5c9424f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:32.699274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c2d4f90-7b12-44ea-a2eb-e641e5c9424f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:32.700828 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c2d4f90-7b12-44ea-a2eb-e641e5c9424f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:32.752388 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fc8bf5d5-9b69-48a2-a0dd-4e84d5a052b6 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:32.753111 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fc8bf5d5-9b69-48a2-a0dd-4e84d5a052b6 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:32.767752 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc8bf5d5-9b69-48a2-a0dd-4e84d5a052b6 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:32.768237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc8bf5d5-9b69-48a2-a0dd-4e84d5a052b6 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:32.769017 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc8bf5d5-9b69-48a2-a0dd-4e84d5a052b6 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:32.769467 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc8bf5d5-9b69-48a2-a0dd-4e84d5a052b6 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:32.893586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5c2d4f90-7b12-44ea-a2eb-e641e5c9424f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:32.901127 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5c2d4f90-7b12-44ea-a2eb-e641e5c9424f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.222049 Jun 02 13:45:32.901892 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 552/1130] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:32 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:32.939852 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fc8bf5d5-9b69-48a2-a0dd-4e84d5a052b6 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:32.947486 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fc8bf5d5-9b69-48a2-a0dd-4e84d5a052b6 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.201070 Jun 02 13:45:32.948324 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 579/1131] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:32 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:33.918269 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c377875a-d818-4b4f-bb34-8a214516992f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:33.918884 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c377875a-d818-4b4f-bb34-8a214516992f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:33.925664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c377875a-d818-4b4f-bb34-8a214516992f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:33.926113 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c377875a-d818-4b4f-bb34-8a214516992f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:33.926893 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c377875a-d818-4b4f-bb34-8a214516992f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:33.927311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c377875a-d818-4b4f-bb34-8a214516992f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:33.966919 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-089adb57-f5f0-417e-ba81-3d9e95b88393 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:33.967795 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-089adb57-f5f0-417e-ba81-3d9e95b88393 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:33.974442 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-089adb57-f5f0-417e-ba81-3d9e95b88393 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:33.974900 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-089adb57-f5f0-417e-ba81-3d9e95b88393 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:33.975677 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-089adb57-f5f0-417e-ba81-3d9e95b88393 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:33.976320 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-089adb57-f5f0-417e-ba81-3d9e95b88393 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:34.188968 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c377875a-d818-4b4f-bb34-8a214516992f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:34.196357 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c377875a-d818-4b4f-bb34-8a214516992f tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.281913 Jun 02 13:45:34.196902 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 553/1132] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:33 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:34.232726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-089adb57-f5f0-417e-ba81-3d9e95b88393 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:34.241956 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-089adb57-f5f0-417e-ba81-3d9e95b88393 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.279576 Jun 02 13:45:34.242527 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 580/1133] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:33 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:35.214028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-878a96c8-fd35-46c3-afc9-bff07450f30c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:35.214787 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-878a96c8-fd35-46c3-afc9-bff07450f30c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:35.218999 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=4 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:35.222958 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-878a96c8-fd35-46c3-afc9-bff07450f30c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:35.223415 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-878a96c8-fd35-46c3-afc9-bff07450f30c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:35.224189 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-878a96c8-fd35-46c3-afc9-bff07450f30c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:35.224665 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-878a96c8-fd35-46c3-afc9-bff07450f30c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:35.260612 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4b6b4f23-927d-4957-8854-44644fed66df tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:35.261956 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4b6b4f23-927d-4957-8854-44644fed66df tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:35.265051 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:35.265863 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=12 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:35.271669 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4b6b4f23-927d-4957-8854-44644fed66df tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:35.272358 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4b6b4f23-927d-4957-8854-44644fed66df tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:35.273366 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4b6b4f23-927d-4957-8854-44644fed66df tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:35.273805 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4b6b4f23-927d-4957-8854-44644fed66df tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:35.431720 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-878a96c8-fd35-46c3-afc9-bff07450f30c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:35.439221 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-878a96c8-fd35-46c3-afc9-bff07450f30c tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.229003 Jun 02 13:45:35.439787 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 554/1134] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:35 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:35.460863 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4b6b4f23-927d-4957-8854-44644fed66df tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:35.473749 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4b6b4f23-927d-4957-8854-44644fed66df tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.215092 Jun 02 13:45:35.474370 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 581/1135] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:35 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:36.457291 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-98241096-fe5f-48e3-aaf1-29d86c8a412d tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:36.457812 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-98241096-fe5f-48e3-aaf1-29d86c8a412d tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:36.464162 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-98241096-fe5f-48e3-aaf1-29d86c8a412d tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:36.464710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-98241096-fe5f-48e3-aaf1-29d86c8a412d tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:36.465466 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-98241096-fe5f-48e3-aaf1-29d86c8a412d tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:36.465898 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-98241096-fe5f-48e3-aaf1-29d86c8a412d tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:36.483586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:36.490465 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a0da0822-5808-4c6d-a726-438feabfbc6a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:36.491202 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a0da0822-5808-4c6d-a726-438feabfbc6a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:36.498316 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0da0822-5808-4c6d-a726-438feabfbc6a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:36.498800 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0da0822-5808-4c6d-a726-438feabfbc6a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:36.499743 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0da0822-5808-4c6d-a726-438feabfbc6a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:36.500251 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0da0822-5808-4c6d-a726-438feabfbc6a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:36.650522 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-98241096-fe5f-48e3-aaf1-29d86c8a412d tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:36.657767 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-98241096-fe5f-48e3-aaf1-29d86c8a412d tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.204479 Jun 02 13:45:36.658364 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 555/1136] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:36 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:36.674653 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a0da0822-5808-4c6d-a726-438feabfbc6a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:36.682011 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a0da0822-5808-4c6d-a726-438feabfbc6a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.195379 Jun 02 13:45:36.682565 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 582/1137] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:36 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:37.661888 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-0d8429b4-2d41-46a4-9cd0-1c78498da067 req-8466f979-49f1-4ab3-bd5a-631b850c7291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d66804-3822-44fb-ada6-af381401c74e", "name": "network-vif-plugged", "status": "completed", "tag": "ed5006ae-d241-4ca4-8eb3-1aa8e1b6ef50"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:37.671834 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-0d8429b4-2d41-46a4-9cd0-1c78498da067 req-8466f979-49f1-4ab3-bd5a-631b850c7291 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:37.672393 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-0d8429b4-2d41-46a4-9cd0-1c78498da067 req-8466f979-49f1-4ab3-bd5a-631b850c7291 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:37.675426 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fef12fb9-3be1-4750-b0ab-6c9e2d76606e tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:37.676662 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fef12fb9-3be1-4750-b0ab-6c9e2d76606e tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:37.683369 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fef12fb9-3be1-4750-b0ab-6c9e2d76606e tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:37.683792 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fef12fb9-3be1-4750-b0ab-6c9e2d76606e tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:37.684606 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fef12fb9-3be1-4750-b0ab-6c9e2d76606e tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:37.685618 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fef12fb9-3be1-4750-b0ab-6c9e2d76606e tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:37.686104 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-0d8429b4-2d41-46a4-9cd0-1c78498da067 req-8466f979-49f1-4ab3-bd5a-631b850c7291 service nova] Creating event network-vif-plugged:ed5006ae-d241-4ca4-8eb3-1aa8e1b6ef50 for instance a4d66804-3822-44fb-ada6-af381401c74e on hv-cinder-83608 Jun 02 13:45:37.691130 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-0d8429b4-2d41-46a4-9cd0-1c78498da067 req-8466f979-49f1-4ab3-bd5a-631b850c7291 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Jun 02 13:45:37.691900 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 556/1138] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:37.700196 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-99a76dbd-b13b-4533-95f4-9fcbd7c08f7b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:37.700940 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-99a76dbd-b13b-4533-95f4-9fcbd7c08f7b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:37.708117 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99a76dbd-b13b-4533-95f4-9fcbd7c08f7b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:37.708797 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99a76dbd-b13b-4533-95f4-9fcbd7c08f7b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:37.709581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99a76dbd-b13b-4533-95f4-9fcbd7c08f7b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:37.710027 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99a76dbd-b13b-4533-95f4-9fcbd7c08f7b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:37.907589 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fef12fb9-3be1-4750-b0ab-6c9e2d76606e tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:37.911283 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:37.917006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fef12fb9-3be1-4750-b0ab-6c9e2d76606e tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.245903 Jun 02 13:45:37.917583 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 583/1139] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:37 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:37.918558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-99a76dbd-b13b-4533-95f4-9fcbd7c08f7b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:37.929403 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-99a76dbd-b13b-4533-95f4-9fcbd7c08f7b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.233298 Jun 02 13:45:37.930158 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 557/1140] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:37 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:38.934027 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-654d1bd8-0fa2-49eb-a6ff-96b9025731af tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:38.935153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-654d1bd8-0fa2-49eb-a6ff-96b9025731af tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:38.942759 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-654d1bd8-0fa2-49eb-a6ff-96b9025731af tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:38.943153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-654d1bd8-0fa2-49eb-a6ff-96b9025731af tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:38.944030 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-654d1bd8-0fa2-49eb-a6ff-96b9025731af tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:38.944601 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-654d1bd8-0fa2-49eb-a6ff-96b9025731af tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:38.950184 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cf6b97be-c23b-44df-b9b8-237690d0781f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:38.951830 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cf6b97be-c23b-44df-b9b8-237690d0781f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:38.958350 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf6b97be-c23b-44df-b9b8-237690d0781f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:38.958808 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf6b97be-c23b-44df-b9b8-237690d0781f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:38.959581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf6b97be-c23b-44df-b9b8-237690d0781f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:38.960020 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf6b97be-c23b-44df-b9b8-237690d0781f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:39.147700 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-654d1bd8-0fa2-49eb-a6ff-96b9025731af tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:39.151089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf6b97be-c23b-44df-b9b8-237690d0781f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:39.155208 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-654d1bd8-0fa2-49eb-a6ff-96b9025731af tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.225004 Jun 02 13:45:39.155774 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 584/1141] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:38 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:39.159426 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cf6b97be-c23b-44df-b9b8-237690d0781f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.213454 Jun 02 13:45:39.159993 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 558/1142] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:38 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:40.172231 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-11b52063-f5d9-4eea-b6d0-7f88fc93d676 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:40.172881 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-11b52063-f5d9-4eea-b6d0-7f88fc93d676 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:40.174885 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2a4b6f99-0f28-4de0-9e86-499fbcae8ceb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:40.175499 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2a4b6f99-0f28-4de0-9e86-499fbcae8ceb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:40.179427 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-11b52063-f5d9-4eea-b6d0-7f88fc93d676 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:40.179896 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-11b52063-f5d9-4eea-b6d0-7f88fc93d676 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:40.180702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-11b52063-f5d9-4eea-b6d0-7f88fc93d676 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:40.181153 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-11b52063-f5d9-4eea-b6d0-7f88fc93d676 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:40.182102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2a4b6f99-0f28-4de0-9e86-499fbcae8ceb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:40.182554 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2a4b6f99-0f28-4de0-9e86-499fbcae8ceb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:40.183322 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2a4b6f99-0f28-4de0-9e86-499fbcae8ceb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:40.183763 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2a4b6f99-0f28-4de0-9e86-499fbcae8ceb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:40.383440 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-11b52063-f5d9-4eea-b6d0-7f88fc93d676 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:40.391627 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-11b52063-f5d9-4eea-b6d0-7f88fc93d676 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.223282 Jun 02 13:45:40.392209 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 585/1143] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:40 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:40.392464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2a4b6f99-0f28-4de0-9e86-499fbcae8ceb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:40.399977 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2a4b6f99-0f28-4de0-9e86-499fbcae8ceb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.228814 Jun 02 13:45:40.400650 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 559/1144] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:40 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:41.408170 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e7bb99ca-1208-4133-85c2-2d1789dc34f8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:41.408821 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e7bb99ca-1208-4133-85c2-2d1789dc34f8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:41.415394 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7bb99ca-1208-4133-85c2-2d1789dc34f8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:41.415847 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7bb99ca-1208-4133-85c2-2d1789dc34f8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:41.416717 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-342bb4f9-fe67-4f6a-be87-5e87755e5de4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:41.417154 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7bb99ca-1208-4133-85c2-2d1789dc34f8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:41.417154 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7bb99ca-1208-4133-85c2-2d1789dc34f8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:41.417339 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-342bb4f9-fe67-4f6a-be87-5e87755e5de4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:41.423723 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-342bb4f9-fe67-4f6a-be87-5e87755e5de4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:41.424178 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-342bb4f9-fe67-4f6a-be87-5e87755e5de4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:41.424988 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-342bb4f9-fe67-4f6a-be87-5e87755e5de4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:41.425429 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-342bb4f9-fe67-4f6a-be87-5e87755e5de4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:41.608280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e7bb99ca-1208-4133-85c2-2d1789dc34f8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:41.611824 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-342bb4f9-fe67-4f6a-be87-5e87755e5de4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:41.615776 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e7bb99ca-1208-4133-85c2-2d1789dc34f8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1314 microversion: 2.1 time: 0.211467 Jun 02 13:45:41.616372 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 586/1145] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:41 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:41.619227 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-342bb4f9-fe67-4f6a-be87-5e87755e5de4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.206300 Jun 02 13:45:41.619783 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 560/1146] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:41 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:42.632964 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a88cc1d9-4a84-4291-97e0-bd0e3c05fed1 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:42.633614 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a88cc1d9-4a84-4291-97e0-bd0e3c05fed1 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:42.635784 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-67b3cba8-6973-4f8a-9e92-ee11dafc5cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:42.636462 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-67b3cba8-6973-4f8a-9e92-ee11dafc5cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:42.640145 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a88cc1d9-4a84-4291-97e0-bd0e3c05fed1 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:42.640636 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a88cc1d9-4a84-4291-97e0-bd0e3c05fed1 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:42.641417 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a88cc1d9-4a84-4291-97e0-bd0e3c05fed1 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:42.641859 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a88cc1d9-4a84-4291-97e0-bd0e3c05fed1 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:42.642783 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67b3cba8-6973-4f8a-9e92-ee11dafc5cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:42.643242 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67b3cba8-6973-4f8a-9e92-ee11dafc5cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:42.644010 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67b3cba8-6973-4f8a-9e92-ee11dafc5cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:42.644483 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67b3cba8-6973-4f8a-9e92-ee11dafc5cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:42.849153 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67b3cba8-6973-4f8a-9e92-ee11dafc5cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:42.854489 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a88cc1d9-4a84-4291-97e0-bd0e3c05fed1 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:42.857176 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-67b3cba8-6973-4f8a-9e92-ee11dafc5cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.225068 Jun 02 13:45:42.863581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a88cc1d9-4a84-4291-97e0-bd0e3c05fed1 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1464 microversion: 2.1 time: 0.234297 Jun 02 13:45:42.864232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 587/1147] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:42 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1464 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:42.866573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 561/1148] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:42 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:42.907815 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c09a3581-2191-419d-924c-0abfbe3e36c8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:42.908473 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c09a3581-2191-419d-924c-0abfbe3e36c8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:42.917520 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c09a3581-2191-419d-924c-0abfbe3e36c8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:42.918419 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c09a3581-2191-419d-924c-0abfbe3e36c8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:42.919381 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c09a3581-2191-419d-924c-0abfbe3e36c8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:42.919999 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c09a3581-2191-419d-924c-0abfbe3e36c8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:42.958489 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c09a3581-2191-419d-924c-0abfbe3e36c8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:45:43.056189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c09a3581-2191-419d-924c-0abfbe3e36c8 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 204 len: 0 microversion: 2.1 time: 0.153081 Jun 02 13:45:43.056902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 588/1149] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:45:42 2022] DELETE /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:45:43.066680 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-31a8bb6e-ee4d-4501-9d81-7461f1623905 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:43.067458 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-31a8bb6e-ee4d-4501-9d81-7461f1623905 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:43.074316 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-31a8bb6e-ee4d-4501-9d81-7461f1623905 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:43.074875 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-31a8bb6e-ee4d-4501-9d81-7461f1623905 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:43.076915 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-31a8bb6e-ee4d-4501-9d81-7461f1623905 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:43.077634 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-31a8bb6e-ee4d-4501-9d81-7461f1623905 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:43.231325 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-31a8bb6e-ee4d-4501-9d81-7461f1623905 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:43.239651 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-31a8bb6e-ee4d-4501-9d81-7461f1623905 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1470 microversion: 2.1 time: 0.177927 Jun 02 13:45:43.240345 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 562/1150] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:43 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:43.875882 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cc616d71-842d-4461-8d9d-53a4ccd7ce8a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:43.876607 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cc616d71-842d-4461-8d9d-53a4ccd7ce8a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:43.883047 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc616d71-842d-4461-8d9d-53a4ccd7ce8a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:43.883488 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc616d71-842d-4461-8d9d-53a4ccd7ce8a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:43.884240 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc616d71-842d-4461-8d9d-53a4ccd7ce8a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:43.884701 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc616d71-842d-4461-8d9d-53a4ccd7ce8a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:44.013554 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cc616d71-842d-4461-8d9d-53a4ccd7ce8a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:44.021105 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cc616d71-842d-4461-8d9d-53a4ccd7ce8a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.150192 Jun 02 13:45:44.021673 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 589/1151] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:43 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:44.257717 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-04a8c1cd-1a6d-487a-8a9f-6c975d764ca3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:44.258341 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-04a8c1cd-1a6d-487a-8a9f-6c975d764ca3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:44.265389 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04a8c1cd-1a6d-487a-8a9f-6c975d764ca3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:44.265839 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04a8c1cd-1a6d-487a-8a9f-6c975d764ca3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:44.266598 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04a8c1cd-1a6d-487a-8a9f-6c975d764ca3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:44.267036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04a8c1cd-1a6d-487a-8a9f-6c975d764ca3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:44.401651 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-04a8c1cd-1a6d-487a-8a9f-6c975d764ca3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:44.410025 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-04a8c1cd-1a6d-487a-8a9f-6c975d764ca3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1470 microversion: 2.1 time: 0.156013 Jun 02 13:45:44.410562 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 563/1152] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:44 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:45.038275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0a85a633-7a7e-4d9a-b7cb-0a96ebe622fd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:45.038902 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0a85a633-7a7e-4d9a-b7cb-0a96ebe622fd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:45.045581 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a85a633-7a7e-4d9a-b7cb-0a96ebe622fd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:45.046037 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a85a633-7a7e-4d9a-b7cb-0a96ebe622fd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:45.046810 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a85a633-7a7e-4d9a-b7cb-0a96ebe622fd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:45.047254 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a85a633-7a7e-4d9a-b7cb-0a96ebe622fd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:45.179623 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0a85a633-7a7e-4d9a-b7cb-0a96ebe622fd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:45.187497 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0a85a633-7a7e-4d9a-b7cb-0a96ebe622fd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.153045 Jun 02 13:45:45.188686 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 590/1153] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:45 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:45.427037 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-67d2859a-1fb9-47d6-86bc-2be3f3dc63a6 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:45.427587 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-67d2859a-1fb9-47d6-86bc-2be3f3dc63a6 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:45.434785 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67d2859a-1fb9-47d6-86bc-2be3f3dc63a6 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:45.435246 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67d2859a-1fb9-47d6-86bc-2be3f3dc63a6 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:45.436014 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67d2859a-1fb9-47d6-86bc-2be3f3dc63a6 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:45.436483 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67d2859a-1fb9-47d6-86bc-2be3f3dc63a6 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:45.564550 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67d2859a-1fb9-47d6-86bc-2be3f3dc63a6 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:45.571980 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-67d2859a-1fb9-47d6-86bc-2be3f3dc63a6 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1470 microversion: 2.1 time: 0.148928 Jun 02 13:45:45.572567 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 564/1154] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:45 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:46.205074 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c9c59b21-d2ca-4334-8309-7002296dfc0d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:46.205716 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c9c59b21-d2ca-4334-8309-7002296dfc0d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:46.212245 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9c59b21-d2ca-4334-8309-7002296dfc0d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:46.212725 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9c59b21-d2ca-4334-8309-7002296dfc0d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:46.213489 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9c59b21-d2ca-4334-8309-7002296dfc0d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:46.213919 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c9c59b21-d2ca-4334-8309-7002296dfc0d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:46.364508 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c9c59b21-d2ca-4334-8309-7002296dfc0d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:46.372578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c9c59b21-d2ca-4334-8309-7002296dfc0d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.171994 Jun 02 13:45:46.373306 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 591/1155] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:46 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:46.598728 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-99ef3152-1265-4447-a310-c0d65d4a9c03 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:46.600098 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-99ef3152-1265-4447-a310-c0d65d4a9c03 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:46.607710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ef3152-1265-4447-a310-c0d65d4a9c03 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:46.608878 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ef3152-1265-4447-a310-c0d65d4a9c03 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:46.610161 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ef3152-1265-4447-a310-c0d65d4a9c03 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:46.610768 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ef3152-1265-4447-a310-c0d65d4a9c03 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:46.752681 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-99ef3152-1265-4447-a310-c0d65d4a9c03 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665084d472824beb91eb2f615b56ceb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97425c4354ba47dc9a4a6e434a57c97e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:46.761354 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-99ef3152-1265-4447-a310-c0d65d4a9c03 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 200 len: 1470 microversion: 2.1 time: 0.166355 Jun 02 13:45:46.763009 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 565/1156] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:46 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:46.966517 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-a1acdd8d-f29e-49ad-bf43-fdb612181152 req-80d7fa0b-24ff-4498-bade-17b82b57da16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d66804-3822-44fb-ada6-af381401c74e", "name": "network-vif-deleted", "tag": "ed5006ae-d241-4ca4-8eb3-1aa8e1b6ef50"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:46.976263 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-a1acdd8d-f29e-49ad-bf43-fdb612181152 req-80d7fa0b-24ff-4498-bade-17b82b57da16 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:46.977237 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-a1acdd8d-f29e-49ad-bf43-fdb612181152 req-80d7fa0b-24ff-4498-bade-17b82b57da16 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:46.991048 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-a1acdd8d-f29e-49ad-bf43-fdb612181152 req-80d7fa0b-24ff-4498-bade-17b82b57da16 service nova] Creating event network-vif-deleted:ed5006ae-d241-4ca4-8eb3-1aa8e1b6ef50 for instance a4d66804-3822-44fb-ada6-af381401c74e on hv-cinder-83608 Jun 02 13:45:47.004947 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-a1acdd8d-f29e-49ad-bf43-fdb612181152 req-80d7fa0b-24ff-4498-bade-17b82b57da16 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042089 Jun 02 13:45:47.006115 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 592/1157] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:47.390207 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-72f229e9-1ac5-4130-8085-3b63708d0a32 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:47.390821 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-72f229e9-1ac5-4130-8085-3b63708d0a32 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:47.397464 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72f229e9-1ac5-4130-8085-3b63708d0a32 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:47.398563 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72f229e9-1ac5-4130-8085-3b63708d0a32 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:47.399372 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72f229e9-1ac5-4130-8085-3b63708d0a32 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:47.399888 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72f229e9-1ac5-4130-8085-3b63708d0a32 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:47.549586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-72f229e9-1ac5-4130-8085-3b63708d0a32 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:47.558237 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-72f229e9-1ac5-4130-8085-3b63708d0a32 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.172112 Jun 02 13:45:47.558917 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 566/1158] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:47 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:47.787067 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ec3d2cd5-a24d-4efe-91b5-b9e8103eb8d3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:47.788219 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ec3d2cd5-a24d-4efe-91b5-b9e8103eb8d3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] [instance: a4d66804-3822-44fb-ada6-af381401c74e] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:47.798444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec3d2cd5-a24d-4efe-91b5-b9e8103eb8d3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:47.799103 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec3d2cd5-a24d-4efe-91b5-b9e8103eb8d3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:47.800242 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec3d2cd5-a24d-4efe-91b5-b9e8103eb8d3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:47.801192 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ec3d2cd5-a24d-4efe-91b5-b9e8103eb8d3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:47.834702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-ec3d2cd5-a24d-4efe-91b5-b9e8103eb8d3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] HTTP exception thrown: Instance a4d66804-3822-44fb-ada6-af381401c74e could not be found. Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ec3d2cd5-a24d-4efe-91b5-b9e8103eb8d3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Request method failure captured: Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e HTTP/1.1 Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimL7w7EkRCv3CVTQ8zSZh-FOewj9vuy7HDzGDv84RjJSQuBbDsqAWHlui4QOCu9dDjczYpUPkeW5BAEOd_puKwdXHu8ZWI44CI_NL_Poi3BiM_t-QsRS3XQXxx6ryaLcQ3Vk_3INVQjVTpL8nXvFUf44EWHAPCiDLbEbvybASJ2zQZdQ Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 97425c4354ba47dc9a4a6e434a57c97e Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesNegativeTest-574860393 Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:45:47.836383 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/97425c4354ba47dc9a4a6e434a57c97e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_97425c4354ba47dc9a4a6e434a57c97e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/97425c4354ba47dc9a4a6e434a57c97e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/97425c4354ba47dc9a4a6e434a57c97e"}]}] Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesNegativeTest-574860393 Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 97425c4354ba47dc9a4a6e434a57c97e Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesNegativeTest-574860393 Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesNegativeTest-574860393-project Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 665084d472824beb91eb2f615b56ceb1 Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesNegativeTest-574860393-project Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance a4d66804-3822-44fb-ada6-af381401c74e could not be found. Jun 02 13:45:47.838174 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'a4d66804-3822-44fb-ada6-af381401c74e'} Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d66804-3822-44fb-ada6-af381401c74e could not be found. Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:45:47.839200 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d66804-3822-44fb-ada6-af381401c74e could not be found. Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d66804-3822-44fb-ada6-af381401c74e could not be found. Jun 02 13:45:47.842307 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:45:47.844817 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ec3d2cd5-a24d-4efe-91b5-b9e8103eb8d3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] Returning 404 to user: Instance a4d66804-3822-44fb-ada6-af381401c74e could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:45:47.844817 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ec3d2cd5-a24d-4efe-91b5-b9e8103eb8d3 tempest-VolumesNegativeTest-574860393 tempest-VolumesNegativeTest-574860393-project] 10.222.0.32 "GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e" status: 404 len: 111 microversion: 2.1 time: 0.060777 Jun 02 13:45:47.844817 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 593/1159] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:47 2022] GET /compute/v2.1/servers/a4d66804-3822-44fb-ada6-af381401c74e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:45:48.123161 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-5b838cad-8373-40fc-bbb0-61db25a26d1d req-fd712fc4-e14e-448c-baef-3f3f937a96ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd3b9ba-53ce-42d2-a66b-a887d8011754", "name": "network-vif-plugged", "status": "completed", "tag": "3173bcbd-6b05-4587-a656-5fddd42b5298"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:48.134747 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-5b838cad-8373-40fc-bbb0-61db25a26d1d req-fd712fc4-e14e-448c-baef-3f3f937a96ec service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:48.135286 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-5b838cad-8373-40fc-bbb0-61db25a26d1d req-fd712fc4-e14e-448c-baef-3f3f937a96ec service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:48.152630 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-5b838cad-8373-40fc-bbb0-61db25a26d1d req-fd712fc4-e14e-448c-baef-3f3f937a96ec service nova] Creating event network-vif-plugged:3173bcbd-6b05-4587-a656-5fddd42b5298 for instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 on hv-cinder-83608 Jun 02 13:45:48.159479 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-5b838cad-8373-40fc-bbb0-61db25a26d1d req-fd712fc4-e14e-448c-baef-3f3f937a96ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041281 Jun 02 13:45:48.160495 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 567/1160] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:45:48.575531 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3061fecc-f67a-46cd-93c5-f44bc25d8fc4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:48.576459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3061fecc-f67a-46cd-93c5-f44bc25d8fc4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:48.583273 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3061fecc-f67a-46cd-93c5-f44bc25d8fc4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:48.583719 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3061fecc-f67a-46cd-93c5-f44bc25d8fc4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:48.584709 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3061fecc-f67a-46cd-93c5-f44bc25d8fc4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:48.585310 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3061fecc-f67a-46cd-93c5-f44bc25d8fc4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:48.794611 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3061fecc-f67a-46cd-93c5-f44bc25d8fc4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:48.802332 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3061fecc-f67a-46cd-93c5-f44bc25d8fc4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1266 microversion: 2.1 time: 0.230688 Jun 02 13:45:48.803189 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 594/1161] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:48 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:45:49.819762 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-833a3655-c9be-43bb-851b-a1732904454a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:49.820792 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-833a3655-c9be-43bb-851b-a1732904454a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:49.827609 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-833a3655-c9be-43bb-851b-a1732904454a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:49.828163 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-833a3655-c9be-43bb-851b-a1732904454a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:49.828989 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-833a3655-c9be-43bb-851b-a1732904454a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:49.829431 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-833a3655-c9be-43bb-851b-a1732904454a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:49.994488 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-833a3655-c9be-43bb-851b-a1732904454a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:50.002376 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-833a3655-c9be-43bb-851b-a1732904454a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1452 microversion: 2.1 time: 0.187311 Jun 02 13:45:50.003829 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 568/1162] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:49 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:50.019811 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-76bf80f6-eeca-47ae-873e-f318f240ca26 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:45:50.020713 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-76bf80f6-eeca-47ae-873e-f318f240ca26 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:45:50.031216 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:50.033109 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76bf80f6-eeca-47ae-873e-f318f240ca26 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:50.034499 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76bf80f6-eeca-47ae-873e-f318f240ca26 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:50.037035 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76bf80f6-eeca-47ae-873e-f318f240ca26 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:50.037528 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76bf80f6-eeca-47ae-873e-f318f240ca26 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:50.220197 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-76bf80f6-eeca-47ae-873e-f318f240ca26 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:45:50.230407 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-76bf80f6-eeca-47ae-873e-f318f240ca26 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1452 microversion: 2.1 time: 0.214897 Jun 02 13:45:50.231798 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 595/1163] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:45:50 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1452 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:45:52.658137 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-46ae5293-0aa6-485c-81fe-7af6aa3bf03c req-0243352e-4bf3-4f91-9f61-c4a6d4b5ed2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd3b9ba-53ce-42d2-a66b-a887d8011754", "tag": "3173bcbd-6b05-4587-a656-5fddd42b5298"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:45:52.668154 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-46ae5293-0aa6-485c-81fe-7af6aa3bf03c req-0243352e-4bf3-4f91-9f61-c4a6d4b5ed2e service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:45:52.668663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-46ae5293-0aa6-485c-81fe-7af6aa3bf03c req-0243352e-4bf3-4f91-9f61-c4a6d4b5ed2e service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:45:52.684152 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-46ae5293-0aa6-485c-81fe-7af6aa3bf03c req-0243352e-4bf3-4f91-9f61-c4a6d4b5ed2e service nova] Creating event network-changed:3173bcbd-6b05-4587-a656-5fddd42b5298 for instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 on hv-cinder-83608 Jun 02 13:45:52.691135 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-46ae5293-0aa6-485c-81fe-7af6aa3bf03c req-0243352e-4bf3-4f91-9f61-c4a6d4b5ed2e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039155 Jun 02 13:45:52.692847 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 569/1164] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:46:15.763863 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:46:15.764617 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Thu Jun 2 13:46:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:47:45.224282 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a9abc871-fff6-4479-958a-c9eec767a829] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 02 13:47:45.225190 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:45.230236 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ddf9831f-a229-4a65-9d57-10563a17a43d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:45.230726 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ddf9831f-a229-4a65-9d57-10563a17a43d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:45.237629 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddf9831f-a229-4a65-9d57-10563a17a43d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:45.238073 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddf9831f-a229-4a65-9d57-10563a17a43d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:45.238903 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddf9831f-a229-4a65-9d57-10563a17a43d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:45.239275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ddf9831f-a229-4a65-9d57-10563a17a43d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:45.265134 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ddf9831f-a229-4a65-9d57-10563a17a43d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:47:45.339582 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ddf9831f-a229-4a65-9d57-10563a17a43d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "DELETE /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 204 len: 0 microversion: 2.1 time: 0.116949 Jun 02 13:47:45.340162 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 596/1165] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:47:45 2022] DELETE /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:47:45.346966 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff89e7d6-4448-4531-8a72-ad2910c702f3] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 13:47:45.347541 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:45.348825 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=74 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:45.353428 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-481676c6-2400-4ca9-a587-3c6699b9b444 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:45.354146 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-481676c6-2400-4ca9-a587-3c6699b9b444 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:45.361522 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-481676c6-2400-4ca9-a587-3c6699b9b444 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:45.361976 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-481676c6-2400-4ca9-a587-3c6699b9b444 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:45.362752 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-481676c6-2400-4ca9-a587-3c6699b9b444 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:45.363195 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-481676c6-2400-4ca9-a587-3c6699b9b444 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:45.610214 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-481676c6-2400-4ca9-a587-3c6699b9b444 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:45.617649 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-481676c6-2400-4ca9-a587-3c6699b9b444 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1577 microversion: 2.1 time: 0.272608 Jun 02 13:47:45.618201 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 570/1166] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:45 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1577 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:47:46.636165 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5d0dd727-88b4-4685-acfe-9f01313a9ac3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:46.636889 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5d0dd727-88b4-4685-acfe-9f01313a9ac3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:46.644177 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5d0dd727-88b4-4685-acfe-9f01313a9ac3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:46.644650 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5d0dd727-88b4-4685-acfe-9f01313a9ac3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:46.645414 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5d0dd727-88b4-4685-acfe-9f01313a9ac3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:46.645854 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5d0dd727-88b4-4685-acfe-9f01313a9ac3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:46.652533 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO oslo.messaging._drivers.impl_rabbit [-] [a9abc871-fff6-4479-958a-c9eec767a829] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 47016. Jun 02 13:47:46.837891 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5d0dd727-88b4-4685-acfe-9f01313a9ac3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:46.845657 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5d0dd727-88b4-4685-acfe-9f01313a9ac3 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1577 microversion: 2.1 time: 0.213736 Jun 02 13:47:46.846227 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 597/1167] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:46 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1577 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:47.862043 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3005492e-c648-4b28-ba14-d64742c8465a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:47.862651 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3005492e-c648-4b28-ba14-d64742c8465a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:47.870046 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3005492e-c648-4b28-ba14-d64742c8465a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:47.870494 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3005492e-c648-4b28-ba14-d64742c8465a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:47.871266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3005492e-c648-4b28-ba14-d64742c8465a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:47.871699 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3005492e-c648-4b28-ba14-d64742c8465a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:47.878100 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff89e7d6-4448-4531-8a72-ad2910c702f3] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 47022. Jun 02 13:47:47.938101 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3005492e-c648-4b28-ba14-d64742c8465a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:47.946217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3005492e-c648-4b28-ba14-d64742c8465a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1510 microversion: 2.1 time: 0.088089 Jun 02 13:47:47.946791 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 571/1168] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:47 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1510 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:48.242045 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-0145f20f-8872-4fc5-9e48-42601d590d75 req-88fefd43-1908-40e9-bdf6-c9e135f74a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd3b9ba-53ce-42d2-a66b-a887d8011754", "name": "network-vif-deleted", "tag": "3173bcbd-6b05-4587-a656-5fddd42b5298"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:47:48.250596 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-0145f20f-8872-4fc5-9e48-42601d590d75 req-88fefd43-1908-40e9-bdf6-c9e135f74a2e service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:48.251083 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-0145f20f-8872-4fc5-9e48-42601d590d75 req-88fefd43-1908-40e9-bdf6-c9e135f74a2e service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:48.265576 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-0145f20f-8872-4fc5-9e48-42601d590d75 req-88fefd43-1908-40e9-bdf6-c9e135f74a2e service nova] Creating event network-vif-deleted:3173bcbd-6b05-4587-a656-5fddd42b5298 for instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 on hv-cinder-83608 Jun 02 13:47:48.271313 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-0145f20f-8872-4fc5-9e48-42601d590d75 req-88fefd43-1908-40e9-bdf6-c9e135f74a2e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107657 Jun 02 13:47:48.272220 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 598/1169] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:47:48.963560 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:48.964384 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:48.982637 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:48.983089 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:48.983892 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:48.984518 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:49.028422 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:49.028884 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:49.029348 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lazy-loading 'fault' on Instance uuid dbd3b9ba-53ce-42d2-a66b-a887d8011754 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:47:49.070997 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:49.078317 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-09523e53-e413-40aa-a8d1-cec2fce58e69 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 200 len: 1185 microversion: 2.1 time: 0.118651 Jun 02 13:47:49.078869 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 572/1170] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:48 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 1185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:50.097608 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-03ec7d5f-851c-47f6-8448-5e582866257d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:50.098799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-03ec7d5f-851c-47f6-8448-5e582866257d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:50.105022 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-03ec7d5f-851c-47f6-8448-5e582866257d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:50.105475 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-03ec7d5f-851c-47f6-8448-5e582866257d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:50.106232 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-03ec7d5f-851c-47f6-8448-5e582866257d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:50.106662 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-03ec7d5f-851c-47f6-8448-5e582866257d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:50.121848 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-03ec7d5f-851c-47f6-8448-5e582866257d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] HTTP exception thrown: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-03ec7d5f-851c-47f6-8448-5e582866257d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Request method failure captured: Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 HTTP/1.1 Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimL7XN73cDAOX8wYWVFYcJ5qVHtk63Hg1rbWJsFHaWRYxS_6fXuWQdS2-Uu_YLlymyoxD2LIyyvT--KN5t7B5jucN5o267ZeoWaDE8KY4DjnN4j1t2KzhGS9MqAh1JCUxRd01UTzlmYFugCPugNCvax4yhYT8UeWg2ym4Xnwq6BU3bZ0 Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 25b312790b9644bb8fbe30d2ab637db0 Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:47:50.122567 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/25b312790b9644bb8fbe30d2ab637db0"}]}] Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 25b312790b9644bb8fbe30d2ab637db0 Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-TestVolumeBootPattern-1167520146-project Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 64d281c3f8e447aaacb073ed0f8c7a35 Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-TestVolumeBootPattern-1167520146-project Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:47:50.124423 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'dbd3b9ba-53ce-42d2-a66b-a887d8011754'} Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:47:50.125359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:47:50.126966 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:47:50.128421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-03ec7d5f-851c-47f6-8448-5e582866257d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Returning 404 to user: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:47:50.128421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-03ec7d5f-851c-47f6-8448-5e582866257d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 404 len: 111 microversion: 2.1 time: 0.031042 Jun 02 13:47:50.128421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 599/1171] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:50 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:47:50.217193 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1738022182", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1204951225", "security_groups": [{"name": "tempest-secgroup-smoke-286801246"}], "block_device_mapping_v2": [{"uuid": "9e5b3f6c-60bc-4569-93d2-e4ad10661d58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8baefc5e-7f63-4469-aeac-36f2a3f9fc2f"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:47:50.330640 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] validate_networks() for [('8baefc5e-7f63-4469-aeac-36f2a3f9fc2f', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:47:50.749063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:47:50.749488 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:47:50.749962 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:47:50.750371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:47:50.750784 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:47:50.763319 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:50.763782 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:50.764664 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:50.765108 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:50.782905 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Getting quotas for project 25b312790b9644bb8fbe30d2ab637db0. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:47:50.786827 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Getting quotas for user 64d281c3f8e447aaacb073ed0f8c7a35 and project 25b312790b9644bb8fbe30d2ab637db0. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:47:50.843806 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:47:50.845927 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9e5b3f6c-60bc-4569-93d2-e4ad10661d58',volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:47:50.975803 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9bd7a18b-a1ed-40dc-b8b8-730446700ba0 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.762410 Jun 02 13:47:50.976465 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 573/1172] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:47:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:47:50.986320 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a7d8c8e6-b489-4c47-b06b-f1746f4785cb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:50.986949 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a7d8c8e6-b489-4c47-b06b-f1746f4785cb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:51.049378 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a7d8c8e6-b489-4c47-b06b-f1746f4785cb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:51.056661 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a7d8c8e6-b489-4c47-b06b-f1746f4785cb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1095 microversion: 2.1 time: 0.074183 Jun 02 13:47:51.057222 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 600/1173] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:50 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:47:52.074360 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e7bd1df9-9903-4a6d-b9cc-f5ac54a85d46 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:52.074982 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e7bd1df9-9903-4a6d-b9cc-f5ac54a85d46 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:52.126549 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e7bd1df9-9903-4a6d-b9cc-f5ac54a85d46 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:52.133756 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e7bd1df9-9903-4a6d-b9cc-f5ac54a85d46 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1095 microversion: 2.1 time: 0.064024 Jun 02 13:47:52.134311 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 574/1174] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:52 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:53.151249 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bd2cd52d-9446-41e3-a252-6d0e07c9a78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:53.151855 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bd2cd52d-9446-41e3-a252-6d0e07c9a78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:53.159549 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd2cd52d-9446-41e3-a252-6d0e07c9a78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:53.160092 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd2cd52d-9446-41e3-a252-6d0e07c9a78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:53.160927 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd2cd52d-9446-41e3-a252-6d0e07c9a78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:53.161362 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bd2cd52d-9446-41e3-a252-6d0e07c9a78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:53.223359 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bd2cd52d-9446-41e3-a252-6d0e07c9a78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:53.232033 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bd2cd52d-9446-41e3-a252-6d0e07c9a78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1145 microversion: 2.1 time: 0.085124 Jun 02 13:47:53.232657 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 601/1175] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:53 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:54.248490 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4ca43b38-65d7-4510-a4a7-47c7ae15d7d5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:54.249124 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4ca43b38-65d7-4510-a4a7-47c7ae15d7d5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:54.256538 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ca43b38-65d7-4510-a4a7-47c7ae15d7d5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:54.257554 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ca43b38-65d7-4510-a4a7-47c7ae15d7d5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:54.258353 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ca43b38-65d7-4510-a4a7-47c7ae15d7d5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:54.258789 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ca43b38-65d7-4510-a4a7-47c7ae15d7d5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:54.329419 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4ca43b38-65d7-4510-a4a7-47c7ae15d7d5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:54.339029 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4ca43b38-65d7-4510-a4a7-47c7ae15d7d5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1201 microversion: 2.1 time: 0.094705 Jun 02 13:47:54.339673 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 575/1176] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:54 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:55.359557 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7510fb05-59d1-4422-80fe-a59b419dcf7d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:55.360545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7510fb05-59d1-4422-80fe-a59b419dcf7d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:55.367505 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7510fb05-59d1-4422-80fe-a59b419dcf7d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:55.368016 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7510fb05-59d1-4422-80fe-a59b419dcf7d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:55.368852 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7510fb05-59d1-4422-80fe-a59b419dcf7d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:55.369293 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7510fb05-59d1-4422-80fe-a59b419dcf7d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:55.523076 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7510fb05-59d1-4422-80fe-a59b419dcf7d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:55.533735 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7510fb05-59d1-4422-80fe-a59b419dcf7d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1266 microversion: 2.1 time: 0.179263 Jun 02 13:47:55.534778 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 602/1177] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:55 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:55.790137 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-a295e77e-f20b-46c3-a672-b23038c11978 req-1da659f1-c30f-42fe-9b29-c20474c005cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd", "tag": "a4a87364-5abb-4580-9f56-b3db990fa486"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:47:55.803470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-a295e77e-f20b-46c3-a672-b23038c11978 req-1da659f1-c30f-42fe-9b29-c20474c005cb service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:55.804157 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-a295e77e-f20b-46c3-a672-b23038c11978 req-1da659f1-c30f-42fe-9b29-c20474c005cb service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:55.822490 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-a295e77e-f20b-46c3-a672-b23038c11978 req-1da659f1-c30f-42fe-9b29-c20474c005cb service nova] Creating event network-changed:a4a87364-5abb-4580-9f56-b3db990fa486 for instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd on hv-cinder-83608 Jun 02 13:47:55.829091 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-a295e77e-f20b-46c3-a672-b23038c11978 req-1da659f1-c30f-42fe-9b29-c20474c005cb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043282 Jun 02 13:47:55.829715 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 576/1178] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:47:56.552085 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6063cdec-baa3-4bf5-8cf1-9619bce33296 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:56.553482 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6063cdec-baa3-4bf5-8cf1-9619bce33296 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:56.561201 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6063cdec-baa3-4bf5-8cf1-9619bce33296 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:56.561780 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6063cdec-baa3-4bf5-8cf1-9619bce33296 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:56.562683 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6063cdec-baa3-4bf5-8cf1-9619bce33296 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:56.563277 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6063cdec-baa3-4bf5-8cf1-9619bce33296 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:56.740337 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6063cdec-baa3-4bf5-8cf1-9619bce33296 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:56.748293 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6063cdec-baa3-4bf5-8cf1-9619bce33296 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1266 microversion: 2.1 time: 0.201273 Jun 02 13:47:56.748944 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 603/1179] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:56 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:57.767562 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5cbfdf8b-3ace-4e94-a17c-4f23eb3e3468 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:57.768243 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5cbfdf8b-3ace-4e94-a17c-4f23eb3e3468 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:57.774807 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5cbfdf8b-3ace-4e94-a17c-4f23eb3e3468 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:57.775443 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5cbfdf8b-3ace-4e94-a17c-4f23eb3e3468 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:57.776241 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5cbfdf8b-3ace-4e94-a17c-4f23eb3e3468 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:57.776835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5cbfdf8b-3ace-4e94-a17c-4f23eb3e3468 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:57.923940 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5cbfdf8b-3ace-4e94-a17c-4f23eb3e3468 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:57.932529 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5cbfdf8b-3ace-4e94-a17c-4f23eb3e3468 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1266 microversion: 2.1 time: 0.171463 Jun 02 13:47:57.933115 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 577/1180] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:57 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:47:58.949062 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-19424b98-1590-4407-b623-dfe4357159fb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:47:58.949882 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-19424b98-1590-4407-b623-dfe4357159fb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:47:58.956632 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19424b98-1590-4407-b623-dfe4357159fb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:58.957118 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19424b98-1590-4407-b623-dfe4357159fb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:58.957871 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19424b98-1590-4407-b623-dfe4357159fb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:47:58.958314 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19424b98-1590-4407-b623-dfe4357159fb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:47:59.098499 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-19424b98-1590-4407-b623-dfe4357159fb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:47:59.107836 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-19424b98-1590-4407-b623-dfe4357159fb tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1266 microversion: 2.1 time: 0.162816 Jun 02 13:47:59.108452 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 604/1181] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:47:58 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:48:00.128066 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f4a2f333-1f87-405d-b9cd-982cf7d4ae97 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:48:00.128938 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f4a2f333-1f87-405d-b9cd-982cf7d4ae97 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:48:00.136581 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f4a2f333-1f87-405d-b9cd-982cf7d4ae97 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:00.137023 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f4a2f333-1f87-405d-b9cd-982cf7d4ae97 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:00.137801 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f4a2f333-1f87-405d-b9cd-982cf7d4ae97 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:00.138231 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f4a2f333-1f87-405d-b9cd-982cf7d4ae97 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:00.292035 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f4a2f333-1f87-405d-b9cd-982cf7d4ae97 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:48:00.305042 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f4a2f333-1f87-405d-b9cd-982cf7d4ae97 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1266 microversion: 2.1 time: 0.181500 Jun 02 13:48:00.305905 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 578/1182] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:48:00 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:48:01.328316 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-af44df39-b94e-4664-b887-2771bca21c6f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:48:01.328953 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-af44df39-b94e-4664-b887-2771bca21c6f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:48:01.331602 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:01.337987 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af44df39-b94e-4664-b887-2771bca21c6f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:01.338444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af44df39-b94e-4664-b887-2771bca21c6f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:01.339231 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af44df39-b94e-4664-b887-2771bca21c6f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:01.339703 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af44df39-b94e-4664-b887-2771bca21c6f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:01.479313 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-af44df39-b94e-4664-b887-2771bca21c6f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:48:01.486996 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-af44df39-b94e-4664-b887-2771bca21c6f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1266 microversion: 2.1 time: 0.162553 Jun 02 13:48:01.487578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 605/1183] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:48:01 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:48:02.504371 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4c1919a1-9491-4c60-b5fa-34373cb239ab tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:48:02.512601 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4c1919a1-9491-4c60-b5fa-34373cb239ab tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:48:02.512601 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:02.512601 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=8 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:48:02.515465 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c1919a1-9491-4c60-b5fa-34373cb239ab tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:02.515955 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c1919a1-9491-4c60-b5fa-34373cb239ab tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:02.516938 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c1919a1-9491-4c60-b5fa-34373cb239ab tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:02.517809 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c1919a1-9491-4c60-b5fa-34373cb239ab tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:02.682080 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4c1919a1-9491-4c60-b5fa-34373cb239ab tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:48:02.693603 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4c1919a1-9491-4c60-b5fa-34373cb239ab tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1266 microversion: 2.1 time: 0.193268 Jun 02 13:48:02.694200 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 579/1184] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:48:02 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:48:03.713559 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fb514fc2-a173-4036-8954-e662ca11b78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:48:03.714219 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fb514fc2-a173-4036-8954-e662ca11b78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:48:03.729130 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fb514fc2-a173-4036-8954-e662ca11b78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:03.729580 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fb514fc2-a173-4036-8954-e662ca11b78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:03.730360 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fb514fc2-a173-4036-8954-e662ca11b78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:03.730799 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fb514fc2-a173-4036-8954-e662ca11b78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:03.868510 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fb514fc2-a173-4036-8954-e662ca11b78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:48:03.876108 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fb514fc2-a173-4036-8954-e662ca11b78f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1266 microversion: 2.1 time: 0.166931 Jun 02 13:48:03.876714 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 606/1185] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:48:03 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:48:04.893755 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-339d0763-7de2-4258-bc42-efeb5f063a72 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:48:04.894447 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-339d0763-7de2-4258-bc42-efeb5f063a72 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:48:04.902940 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-339d0763-7de2-4258-bc42-efeb5f063a72 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:04.903663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-339d0763-7de2-4258-bc42-efeb5f063a72 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:04.904112 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-339d0763-7de2-4258-bc42-efeb5f063a72 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:04.904622 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-339d0763-7de2-4258-bc42-efeb5f063a72 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:05.066529 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-339d0763-7de2-4258-bc42-efeb5f063a72 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:48:05.070838 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-93d2c637-4630-4828-856a-eb462092a1f4 req-5f159854-ed17-4225-bf86-864d0e37828d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd", "name": "network-vif-plugged", "status": "completed", "tag": "a4a87364-5abb-4580-9f56-b3db990fa486"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:48:05.076480 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-339d0763-7de2-4258-bc42-efeb5f063a72 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1266 microversion: 2.1 time: 0.186608 Jun 02 13:48:05.077060 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 580/1186] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:48:04 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:48:05.079755 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-93d2c637-4630-4828-856a-eb462092a1f4 req-5f159854-ed17-4225-bf86-864d0e37828d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:05.080206 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-93d2c637-4630-4828-856a-eb462092a1f4 req-5f159854-ed17-4225-bf86-864d0e37828d service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:05.093098 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-93d2c637-4630-4828-856a-eb462092a1f4 req-5f159854-ed17-4225-bf86-864d0e37828d service nova] Creating event network-vif-plugged:a4a87364-5abb-4580-9f56-b3db990fa486 for instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd on hv-cinder-83608 Jun 02 13:48:05.098958 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-93d2c637-4630-4828-856a-eb462092a1f4 req-5f159854-ed17-4225-bf86-864d0e37828d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122272 Jun 02 13:48:05.099329 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 607/1187] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:48:06.094271 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-df883fef-fe2d-48d9-b375-f8eb13c5b7aa tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:48:06.094917 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-df883fef-fe2d-48d9-b375-f8eb13c5b7aa tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:48:06.101615 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df883fef-fe2d-48d9-b375-f8eb13c5b7aa tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:06.102072 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df883fef-fe2d-48d9-b375-f8eb13c5b7aa tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:06.102855 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df883fef-fe2d-48d9-b375-f8eb13c5b7aa tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:06.103296 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df883fef-fe2d-48d9-b375-f8eb13c5b7aa tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:06.256405 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-df883fef-fe2d-48d9-b375-f8eb13c5b7aa tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:48:06.265120 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-df883fef-fe2d-48d9-b375-f8eb13c5b7aa tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1266 microversion: 2.1 time: 0.174660 Jun 02 13:48:06.265616 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 581/1188] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:48:06 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:48:06.643525 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:48:06.644128 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Thu Jun 2 13:48:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:48:07.284941 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0b8e9228-7838-403b-b29d-c1119e935f1d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:48:07.285554 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0b8e9228-7838-403b-b29d-c1119e935f1d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:48:07.292692 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0b8e9228-7838-403b-b29d-c1119e935f1d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:07.293141 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0b8e9228-7838-403b-b29d-c1119e935f1d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:07.293948 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0b8e9228-7838-403b-b29d-c1119e935f1d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:07.294354 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0b8e9228-7838-403b-b29d-c1119e935f1d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:07.437314 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0b8e9228-7838-403b-b29d-c1119e935f1d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:48:07.445497 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0b8e9228-7838-403b-b29d-c1119e935f1d tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1452 microversion: 2.1 time: 0.165639 Jun 02 13:48:07.446614 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 608/1189] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:48:07 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:48:07.464087 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0c72d7d3-23e7-452d-b28c-26f9fd7fa6bc tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:48:07.464716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0c72d7d3-23e7-452d-b28c-26f9fd7fa6bc tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:48:07.471726 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0c72d7d3-23e7-452d-b28c-26f9fd7fa6bc tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:07.472190 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0c72d7d3-23e7-452d-b28c-26f9fd7fa6bc tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:07.473047 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0c72d7d3-23e7-452d-b28c-26f9fd7fa6bc tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:07.473482 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0c72d7d3-23e7-452d-b28c-26f9fd7fa6bc tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:07.556831 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:48:07.557111 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Thu Jun 2 13:48:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd (ip 10.222.0.32) !!! Jun 02 13:48:07.618700 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0c72d7d3-23e7-452d-b28c-26f9fd7fa6bc tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:48:07.626845 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0c72d7d3-23e7-452d-b28c-26f9fd7fa6bc tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1452 microversion: 2.1 time: 0.167150 Jun 02 13:48:07.627416 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 582/1190] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:48:07 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:48:09.524702 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-5aca9fcf-2d24-404a-a144-2525e6ce42e3 req-d0428a6d-f07d-4841-bf4c-66c623376ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd", "tag": "a4a87364-5abb-4580-9f56-b3db990fa486"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:48:09.533444 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-5aca9fcf-2d24-404a-a144-2525e6ce42e3 req-d0428a6d-f07d-4841-bf4c-66c623376ddd service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:48:09.533885 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-5aca9fcf-2d24-404a-a144-2525e6ce42e3 req-d0428a6d-f07d-4841-bf4c-66c623376ddd service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:48:09.545523 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-5aca9fcf-2d24-404a-a144-2525e6ce42e3 req-d0428a6d-f07d-4841-bf4c-66c623376ddd service nova] Creating event network-changed:a4a87364-5abb-4580-9f56-b3db990fa486 for instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd on hv-cinder-83608 Jun 02 13:48:09.551085 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-5aca9fcf-2d24-404a-a144-2525e6ce42e3 req-d0428a6d-f07d-4841-bf4c-66c623376ddd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029988 Jun 02 13:48:09.551763 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 609/1191] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:49:41.337002 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:49:41.337729 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Thu Jun 2 13:49:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:49:57.141350 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:57.142096 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=66 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:57.146075 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-454667010", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1204951225", "security_groups": [{"name": "tempest-secgroup-smoke-286801246"}], "block_device_mapping_v2": [{"uuid": "0e11c73a-b9fb-434b-b79e-99c9f56d5e60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8baefc5e-7f63-4469-aeac-36f2a3f9fc2f"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:49:57.265783 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] validate_networks() for [('8baefc5e-7f63-4469-aeac-36f2a3f9fc2f', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 13:49:57.633247 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 13:49:57.633674 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 13:49:57.634148 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 13:49:57.634560 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 13:49:57.634971 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 13:49:57.653328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:49:57.653782 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:49:57.654591 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:49:57.655028 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:49:57.673176 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Getting quotas for project 25b312790b9644bb8fbe30d2ab637db0. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 13:49:57.677133 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Getting quotas for user 64d281c3f8e447aaacb073ed0f8c7a35 and project 25b312790b9644bb8fbe30d2ab637db0. Resources: {'cores', 'instances', 'ram'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 13:49:57.744588 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 13:49:57.747327 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e11c73a-b9fb-434b-b79e-99c9f56d5e60',volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 13:49:57.874063 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-27a2e6ba-5a17-4dfc-8a45-171c9f1d2687 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.734391 Jun 02 13:49:57.874710 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 583/1192] 10.222.0.32 () {60 vars in 1146 bytes} [Thu Jun 2 13:49:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 13:49:57.886770 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7de19691-1541-4893-b1ed-08cccd7ec76f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:49:57.887555 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7de19691-1541-4893-b1ed-08cccd7ec76f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:49:57.890578 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:57.891499 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:49:57.950069 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7de19691-1541-4893-b1ed-08cccd7ec76f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:49:57.956930 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7de19691-1541-4893-b1ed-08cccd7ec76f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1094 microversion: 2.1 time: 0.075521 Jun 02 13:49:57.957493 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 610/1193] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:49:57 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:49:58.974602 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7603b6f6-6eb9-41c3-ab82-fb1dc00dff2b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:49:58.975258 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7603b6f6-6eb9-41c3-ab82-fb1dc00dff2b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:49:58.982622 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7603b6f6-6eb9-41c3-ab82-fb1dc00dff2b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:49:58.983102 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7603b6f6-6eb9-41c3-ab82-fb1dc00dff2b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:49:58.983868 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7603b6f6-6eb9-41c3-ab82-fb1dc00dff2b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:49:58.984331 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7603b6f6-6eb9-41c3-ab82-fb1dc00dff2b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:49:59.050039 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7603b6f6-6eb9-41c3-ab82-fb1dc00dff2b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:49:59.057879 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7603b6f6-6eb9-41c3-ab82-fb1dc00dff2b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1192 microversion: 2.1 time: 0.087750 Jun 02 13:49:59.058499 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 584/1194] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:49:58 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:00.076263 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d1ec4835-4f85-4796-b6b1-9067278d7678 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:00.076864 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d1ec4835-4f85-4796-b6b1-9067278d7678 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:00.085291 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1ec4835-4f85-4796-b6b1-9067278d7678 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:00.085531 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1ec4835-4f85-4796-b6b1-9067278d7678 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:00.086202 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1ec4835-4f85-4796-b6b1-9067278d7678 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:00.086648 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d1ec4835-4f85-4796-b6b1-9067278d7678 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:00.237619 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d1ec4835-4f85-4796-b6b1-9067278d7678 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:00.247598 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d1ec4835-4f85-4796-b6b1-9067278d7678 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.176192 Jun 02 13:50:00.248704 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 611/1195] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:00 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:00.556270 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-f090a18c-59a9-4c46-b363-049589221228 req-e2a447d8-7316-43aa-af4b-3464aa53ed7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f5ddc2-faed-4f70-86d0-0b2ff8e118bc", "tag": "c160bf08-63b8-4ac2-aac7-09880ef3ed5e"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:50:00.567830 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-f090a18c-59a9-4c46-b363-049589221228 req-e2a447d8-7316-43aa-af4b-3464aa53ed7e service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:00.568776 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-f090a18c-59a9-4c46-b363-049589221228 req-e2a447d8-7316-43aa-af4b-3464aa53ed7e service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:00.582520 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-f090a18c-59a9-4c46-b363-049589221228 req-e2a447d8-7316-43aa-af4b-3464aa53ed7e service nova] Creating event network-changed:c160bf08-63b8-4ac2-aac7-09880ef3ed5e for instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc on hv-cinder-83608 Jun 02 13:50:00.587795 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-f090a18c-59a9-4c46-b363-049589221228 req-e2a447d8-7316-43aa-af4b-3464aa53ed7e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035532 Jun 02 13:50:00.591077 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 585/1196] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:50:01.335275 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-66fede12-67fc-4dc7-8036-ffce071ec967 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:01.336129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-66fede12-67fc-4dc7-8036-ffce071ec967 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:01.343280 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66fede12-67fc-4dc7-8036-ffce071ec967 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:01.343736 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66fede12-67fc-4dc7-8036-ffce071ec967 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:01.344548 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66fede12-67fc-4dc7-8036-ffce071ec967 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:01.344992 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66fede12-67fc-4dc7-8036-ffce071ec967 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:01.478451 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-66fede12-67fc-4dc7-8036-ffce071ec967 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:01.486088 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-66fede12-67fc-4dc7-8036-ffce071ec967 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.224911 Jun 02 13:50:01.486658 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 612/1197] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:01 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:02.504174 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-af2433c5-11a6-4293-89ed-3e4fa27ce1a7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:02.504956 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-af2433c5-11a6-4293-89ed-3e4fa27ce1a7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:02.511765 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af2433c5-11a6-4293-89ed-3e4fa27ce1a7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:02.512240 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af2433c5-11a6-4293-89ed-3e4fa27ce1a7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:02.513060 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af2433c5-11a6-4293-89ed-3e4fa27ce1a7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:02.513501 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af2433c5-11a6-4293-89ed-3e4fa27ce1a7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:02.651808 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-af2433c5-11a6-4293-89ed-3e4fa27ce1a7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:02.660273 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-af2433c5-11a6-4293-89ed-3e4fa27ce1a7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.160993 Jun 02 13:50:02.660874 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 586/1198] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:02 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:03.677737 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ca7598d3-67ae-4d10-b40b-633c96bfe207 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:03.678346 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ca7598d3-67ae-4d10-b40b-633c96bfe207 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:03.686071 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca7598d3-67ae-4d10-b40b-633c96bfe207 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:03.686519 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca7598d3-67ae-4d10-b40b-633c96bfe207 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:03.687293 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca7598d3-67ae-4d10-b40b-633c96bfe207 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:03.687728 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca7598d3-67ae-4d10-b40b-633c96bfe207 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:03.826652 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ca7598d3-67ae-4d10-b40b-633c96bfe207 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:03.834194 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ca7598d3-67ae-4d10-b40b-633c96bfe207 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.160408 Jun 02 13:50:03.834757 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 613/1199] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:03 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:04.852224 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ccc59ac7-fad5-4fe3-99e1-cee4aa4c8944 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:04.853032 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ccc59ac7-fad5-4fe3-99e1-cee4aa4c8944 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:04.859797 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ccc59ac7-fad5-4fe3-99e1-cee4aa4c8944 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:04.860248 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ccc59ac7-fad5-4fe3-99e1-cee4aa4c8944 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:04.861069 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ccc59ac7-fad5-4fe3-99e1-cee4aa4c8944 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:04.861516 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ccc59ac7-fad5-4fe3-99e1-cee4aa4c8944 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:05.021156 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ccc59ac7-fad5-4fe3-99e1-cee4aa4c8944 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:05.028956 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ccc59ac7-fad5-4fe3-99e1-cee4aa4c8944 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.180974 Jun 02 13:50:05.029540 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 587/1200] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:04 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:06.046356 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b498c4a1-7653-4e4e-b2b0-50b8f796acda tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:06.046962 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b498c4a1-7653-4e4e-b2b0-50b8f796acda tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:06.053479 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b498c4a1-7653-4e4e-b2b0-50b8f796acda tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:06.053957 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b498c4a1-7653-4e4e-b2b0-50b8f796acda tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:06.054719 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b498c4a1-7653-4e4e-b2b0-50b8f796acda tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:06.055155 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b498c4a1-7653-4e4e-b2b0-50b8f796acda tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:06.193597 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b498c4a1-7653-4e4e-b2b0-50b8f796acda tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:06.201421 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b498c4a1-7653-4e4e-b2b0-50b8f796acda tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.159451 Jun 02 13:50:06.201992 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 614/1201] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:06 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:07.218218 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8f15e2bf-65eb-4e3c-893a-e71bf6b4a1a9 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:07.218782 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8f15e2bf-65eb-4e3c-893a-e71bf6b4a1a9 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:07.225527 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f15e2bf-65eb-4e3c-893a-e71bf6b4a1a9 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:07.226030 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f15e2bf-65eb-4e3c-893a-e71bf6b4a1a9 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:07.226789 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f15e2bf-65eb-4e3c-893a-e71bf6b4a1a9 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:07.227288 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f15e2bf-65eb-4e3c-893a-e71bf6b4a1a9 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:07.361661 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8f15e2bf-65eb-4e3c-893a-e71bf6b4a1a9 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:07.369228 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8f15e2bf-65eb-4e3c-893a-e71bf6b4a1a9 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.155035 Jun 02 13:50:07.369790 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 588/1202] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:07 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:08.387334 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-079b1840-3afa-4d16-a31a-0afa25e9bc8c tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:08.387961 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-079b1840-3afa-4d16-a31a-0afa25e9bc8c tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:08.390401 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:08.397217 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-079b1840-3afa-4d16-a31a-0afa25e9bc8c tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:08.397675 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-079b1840-3afa-4d16-a31a-0afa25e9bc8c tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:08.398458 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-079b1840-3afa-4d16-a31a-0afa25e9bc8c tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:08.398899 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-079b1840-3afa-4d16-a31a-0afa25e9bc8c tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:08.538633 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-079b1840-3afa-4d16-a31a-0afa25e9bc8c tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:08.547058 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-079b1840-3afa-4d16-a31a-0afa25e9bc8c tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.163983 Jun 02 13:50:08.547642 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 615/1203] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:08 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:09.563680 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-678aba51-de24-440d-83c1-0c56edfd9498 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:09.564332 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-678aba51-de24-440d-83c1-0c56edfd9498 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:09.566360 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:09.567023 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=6 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:09.573891 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-678aba51-de24-440d-83c1-0c56edfd9498 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:09.574439 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-678aba51-de24-440d-83c1-0c56edfd9498 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:09.575217 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-678aba51-de24-440d-83c1-0c56edfd9498 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:09.575663 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-678aba51-de24-440d-83c1-0c56edfd9498 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:09.716959 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-678aba51-de24-440d-83c1-0c56edfd9498 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:09.725816 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-678aba51-de24-440d-83c1-0c56edfd9498 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.165992 Jun 02 13:50:09.726428 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 589/1204] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:09 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:10.743553 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2597a21a-621e-48d6-bd65-41c703d6ae83 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:10.744471 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2597a21a-621e-48d6-bd65-41c703d6ae83 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:10.750704 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2597a21a-621e-48d6-bd65-41c703d6ae83 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:10.751150 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2597a21a-621e-48d6-bd65-41c703d6ae83 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:10.751912 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2597a21a-621e-48d6-bd65-41c703d6ae83 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:10.752375 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2597a21a-621e-48d6-bd65-41c703d6ae83 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:10.886940 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2597a21a-621e-48d6-bd65-41c703d6ae83 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:10.894479 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2597a21a-621e-48d6-bd65-41c703d6ae83 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.155070 Jun 02 13:50:10.895049 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 616/1205] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:10 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:50:11.471277 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-25d97797-d87c-4880-88ae-bc4523683284 req-127a3a16-7153-4833-9780-604f1ae2dfd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f5ddc2-faed-4f70-86d0-0b2ff8e118bc", "name": "network-vif-plugged", "status": "completed", "tag": "c160bf08-63b8-4ac2-aac7-09880ef3ed5e"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:50:11.484724 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-25d97797-d87c-4880-88ae-bc4523683284 req-127a3a16-7153-4833-9780-604f1ae2dfd1 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:11.485377 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-25d97797-d87c-4880-88ae-bc4523683284 req-127a3a16-7153-4833-9780-604f1ae2dfd1 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:11.500389 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-25d97797-d87c-4880-88ae-bc4523683284 req-127a3a16-7153-4833-9780-604f1ae2dfd1 service nova] Creating event network-vif-plugged:c160bf08-63b8-4ac2-aac7-09880ef3ed5e for instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc on hv-cinder-83608 Jun 02 13:50:11.505288 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-25d97797-d87c-4880-88ae-bc4523683284 req-127a3a16-7153-4833-9780-604f1ae2dfd1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040333 Jun 02 13:50:11.505834 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 590/1206] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:50:11.911719 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ee4dd400-4a96-4353-affb-672cc9de8773 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:11.912341 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ee4dd400-4a96-4353-affb-672cc9de8773 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:11.919558 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ee4dd400-4a96-4353-affb-672cc9de8773 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:11.920006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ee4dd400-4a96-4353-affb-672cc9de8773 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:11.920820 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ee4dd400-4a96-4353-affb-672cc9de8773 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:11.921258 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ee4dd400-4a96-4353-affb-672cc9de8773 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:12.062991 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ee4dd400-4a96-4353-affb-672cc9de8773 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:12.071161 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ee4dd400-4a96-4353-affb-672cc9de8773 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1265 microversion: 2.1 time: 0.163314 Jun 02 13:50:12.071723 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 617/1207] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:11 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:13.089733 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dbc92103-49d1-4e87-863e-4b434cce70dd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:13.090437 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dbc92103-49d1-4e87-863e-4b434cce70dd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:13.096856 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dbc92103-49d1-4e87-863e-4b434cce70dd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:13.097339 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dbc92103-49d1-4e87-863e-4b434cce70dd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:13.098108 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dbc92103-49d1-4e87-863e-4b434cce70dd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:13.098558 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dbc92103-49d1-4e87-863e-4b434cce70dd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:13.230485 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dbc92103-49d1-4e87-863e-4b434cce70dd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:13.238062 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dbc92103-49d1-4e87-863e-4b434cce70dd tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1451 microversion: 2.1 time: 0.153020 Jun 02 13:50:13.238619 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 591/1208] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:13 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:13.254788 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2f2f9755-cb34-4b40-b004-4ad37116d20a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:50:13.255397 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2f2f9755-cb34-4b40-b004-4ad37116d20a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:50:13.261879 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f2f9755-cb34-4b40-b004-4ad37116d20a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:13.262327 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f2f9755-cb34-4b40-b004-4ad37116d20a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:13.263091 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f2f9755-cb34-4b40-b004-4ad37116d20a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:13.263527 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f2f9755-cb34-4b40-b004-4ad37116d20a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:13.397779 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2f2f9755-cb34-4b40-b004-4ad37116d20a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:50:13.405787 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2f2f9755-cb34-4b40-b004-4ad37116d20a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1451 microversion: 2.1 time: 0.154738 Jun 02 13:50:13.406373 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 618/1209] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:50:13 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:50:15.279484 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-6e1b688a-34b6-47d9-ba68-06e1409c32d0 req-be7d1d97-4b04-4727-9b2e-e211ca8045f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f5ddc2-faed-4f70-86d0-0b2ff8e118bc", "tag": "c160bf08-63b8-4ac2-aac7-09880ef3ed5e"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:50:15.288138 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-6e1b688a-34b6-47d9-ba68-06e1409c32d0 req-be7d1d97-4b04-4727-9b2e-e211ca8045f6 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:50:15.288612 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-6e1b688a-34b6-47d9-ba68-06e1409c32d0 req-be7d1d97-4b04-4727-9b2e-e211ca8045f6 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:50:15.300966 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-6e1b688a-34b6-47d9-ba68-06e1409c32d0 req-be7d1d97-4b04-4727-9b2e-e211ca8045f6 service nova] Creating event network-changed:c160bf08-63b8-4ac2-aac7-09880ef3ed5e for instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc on hv-cinder-83608 Jun 02 13:50:15.306530 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-6e1b688a-34b6-47d9-ba68-06e1409c32d0 req-be7d1d97-4b04-4727-9b2e-e211ca8045f6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031284 Jun 02 13:50:15.307149 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 592/1210] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:51:26.652454 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:51:26.653145 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Thu Jun 2 13:51:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:51:27.571080 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:51:27.571687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Thu Jun 2 13:51:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:51:43.444092 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=20 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:43.444869 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=48 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:43.446790 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:43.447520 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=44 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:43.448818 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fc22df66-ecc1-4edf-b0ec-030fb0f4b85a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:43.449319 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fc22df66-ecc1-4edf-b0ec-030fb0f4b85a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:43.452092 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-abb3ff30-bd1f-4861-b45d-f78ddeb3d06b req-b388d1ce-2083-4812-9cd7-5757be2e291a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f5ddc2-faed-4f70-86d0-0b2ff8e118bc", "tag": "c160bf08-63b8-4ac2-aac7-09880ef3ed5e"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:51:43.456288 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc22df66-ecc1-4edf-b0ec-030fb0f4b85a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:43.456890 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc22df66-ecc1-4edf-b0ec-030fb0f4b85a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:43.457669 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc22df66-ecc1-4edf-b0ec-030fb0f4b85a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:43.458120 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc22df66-ecc1-4edf-b0ec-030fb0f4b85a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:43.462114 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-abb3ff30-bd1f-4861-b45d-f78ddeb3d06b req-b388d1ce-2083-4812-9cd7-5757be2e291a service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:43.462562 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-abb3ff30-bd1f-4861-b45d-f78ddeb3d06b req-b388d1ce-2083-4812-9cd7-5757be2e291a service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:43.474192 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-abb3ff30-bd1f-4861-b45d-f78ddeb3d06b req-b388d1ce-2083-4812-9cd7-5757be2e291a service nova] Creating event network-changed:c160bf08-63b8-4ac2-aac7-09880ef3ed5e for instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc on hv-cinder-83608 Jun 02 13:51:43.480345 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-abb3ff30-bd1f-4861-b45d-f78ddeb3d06b req-b388d1ce-2083-4812-9cd7-5757be2e291a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035619 Jun 02 13:51:43.481173 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 593/1211] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:51:43.491917 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fc22df66-ecc1-4edf-b0ec-030fb0f4b85a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:51:43.576274 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fc22df66-ecc1-4edf-b0ec-030fb0f4b85a tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "DELETE /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 204 len: 0 microversion: 2.1 time: 0.133850 Jun 02 13:51:43.577049 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 619/1212] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:51:43 2022] DELETE /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:51:43.586857 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-70a470aa-f279-428b-86e9-3b40de562519 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:43.587573 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-70a470aa-f279-428b-86e9-3b40de562519 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:43.593957 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70a470aa-f279-428b-86e9-3b40de562519 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:43.594419 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70a470aa-f279-428b-86e9-3b40de562519 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:43.595225 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70a470aa-f279-428b-86e9-3b40de562519 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:43.595835 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70a470aa-f279-428b-86e9-3b40de562519 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:43.735163 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70a470aa-f279-428b-86e9-3b40de562519 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:51:43.742713 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-70a470aa-f279-428b-86e9-3b40de562519 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1576 microversion: 2.1 time: 0.161114 Jun 02 13:51:43.743270 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 594/1213] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:51:43 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:51:44.760129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-36e0eb2d-e291-41e1-9eb9-0fde118e12c7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:44.760849 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-36e0eb2d-e291-41e1-9eb9-0fde118e12c7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:44.767295 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-36e0eb2d-e291-41e1-9eb9-0fde118e12c7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:44.767743 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-36e0eb2d-e291-41e1-9eb9-0fde118e12c7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:44.768526 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-36e0eb2d-e291-41e1-9eb9-0fde118e12c7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:44.768960 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-36e0eb2d-e291-41e1-9eb9-0fde118e12c7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:44.903556 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-36e0eb2d-e291-41e1-9eb9-0fde118e12c7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:51:44.911989 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-36e0eb2d-e291-41e1-9eb9-0fde118e12c7 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1576 microversion: 2.1 time: 0.156537 Jun 02 13:51:44.912616 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 620/1214] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:51:44 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:51:45.879652 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-2573e426-4321-4788-a324-4f0f8c1a3665 req-49bdbe8c-45c2-46c8-bf50-42253cce726f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f5ddc2-faed-4f70-86d0-0b2ff8e118bc", "name": "network-vif-deleted", "tag": "c160bf08-63b8-4ac2-aac7-09880ef3ed5e"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:51:45.887706 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-2573e426-4321-4788-a324-4f0f8c1a3665 req-49bdbe8c-45c2-46c8-bf50-42253cce726f service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:45.888162 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-2573e426-4321-4788-a324-4f0f8c1a3665 req-49bdbe8c-45c2-46c8-bf50-42253cce726f service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:45.899492 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-2573e426-4321-4788-a324-4f0f8c1a3665 req-49bdbe8c-45c2-46c8-bf50-42253cce726f service nova] Creating event network-vif-deleted:c160bf08-63b8-4ac2-aac7-09880ef3ed5e for instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc on hv-cinder-83608 Jun 02 13:51:45.904015 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-2573e426-4321-4788-a324-4f0f8c1a3665 req-49bdbe8c-45c2-46c8-bf50-42253cce726f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103669 Jun 02 13:51:45.904621 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 595/1215] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:51:45.928210 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2f4df437-eedb-479d-8bf0-3158f109b7cf tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:45.928864 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2f4df437-eedb-479d-8bf0-3158f109b7cf tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:45.935355 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f4df437-eedb-479d-8bf0-3158f109b7cf tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:45.936018 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f4df437-eedb-479d-8bf0-3158f109b7cf tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:45.936882 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f4df437-eedb-479d-8bf0-3158f109b7cf tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:45.937323 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f4df437-eedb-479d-8bf0-3158f109b7cf tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:45.998627 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2f4df437-eedb-479d-8bf0-3158f109b7cf tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:51:46.006804 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2f4df437-eedb-479d-8bf0-3158f109b7cf tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 200 len: 1225 microversion: 2.1 time: 0.082345 Jun 02 13:51:46.007776 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 621/1216] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:51:45 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:51:47.024712 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-803fa91b-8306-472c-a3ec-6f36f2df0460 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:47.025416 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-803fa91b-8306-472c-a3ec-6f36f2df0460 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:47.031589 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-803fa91b-8306-472c-a3ec-6f36f2df0460 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:47.032036 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-803fa91b-8306-472c-a3ec-6f36f2df0460 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:47.032818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-803fa91b-8306-472c-a3ec-6f36f2df0460 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:47.033254 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-803fa91b-8306-472c-a3ec-6f36f2df0460 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:47.046818 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-803fa91b-8306-472c-a3ec-6f36f2df0460 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] HTTP exception thrown: Instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc could not be found. Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-803fa91b-8306-472c-a3ec-6f36f2df0460 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Request method failure captured: Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc HTTP/1.1 Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimL7XN73cDAOX8wYWVFYcJ5qVHtk63Hg1rbWJsFHaWRYxS_6fXuWQdS2-Uu_YLlymyoxD2LIyyvT--KN5t7B5jucN5o267ZeoWaDE8KY4DjnN4j1t2KzhGS9MqAh1JCUxRd01UTzlmYFugCPugNCvax4yhYT8UeWg2ym4Xnwq6BU3bZ0 Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 25b312790b9644bb8fbe30d2ab637db0 Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:51:47.048432 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/25b312790b9644bb8fbe30d2ab637db0"}]}] Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 25b312790b9644bb8fbe30d2ab637db0 Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-TestVolumeBootPattern-1167520146-project Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 64d281c3f8e447aaacb073ed0f8c7a35 Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestVolumeBootPattern-1167520146-project Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc could not be found. Jun 02 13:51:47.050245 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '93f5ddc2-faed-4f70-86d0-0b2ff8e118bc'} Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc could not be found. Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:51:47.051510 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc could not be found. Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc could not be found. Jun 02 13:51:47.054208 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:47.055711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-803fa91b-8306-472c-a3ec-6f36f2df0460 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Returning 404 to user: Instance 93f5ddc2-faed-4f70-86d0-0b2ff8e118bc could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:51:47.055711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-803fa91b-8306-472c-a3ec-6f36f2df0460 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc" status: 404 len: 111 microversion: 2.1 time: 0.029960 Jun 02 13:51:47.055711 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 596/1217] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:51:47 2022] GET /compute/v2.1/servers/93f5ddc2-faed-4f70-86d0-0b2ff8e118bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:51:50.449625 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e2f69f8d-a62e-45f2-8beb-a2e8eb5e4f4f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:50.450187 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e2f69f8d-a62e-45f2-8beb-a2e8eb5e4f4f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:50.450900 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-ae493a6e-c3d7-41d3-97f1-955afbb28f03 req-82565ff6-9250-456d-af74-b6e98f006fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd", "tag": "a4a87364-5abb-4580-9f56-b3db990fa486"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:51:50.458512 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2f69f8d-a62e-45f2-8beb-a2e8eb5e4f4f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:50.458512 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2f69f8d-a62e-45f2-8beb-a2e8eb5e4f4f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:50.458512 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2f69f8d-a62e-45f2-8beb-a2e8eb5e4f4f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:50.459526 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e2f69f8d-a62e-45f2-8beb-a2e8eb5e4f4f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:50.460863 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-ae493a6e-c3d7-41d3-97f1-955afbb28f03 req-82565ff6-9250-456d-af74-b6e98f006fb3 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:50.461585 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-ae493a6e-c3d7-41d3-97f1-955afbb28f03 req-82565ff6-9250-456d-af74-b6e98f006fb3 service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:50.475507 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-ae493a6e-c3d7-41d3-97f1-955afbb28f03 req-82565ff6-9250-456d-af74-b6e98f006fb3 service nova] Creating event network-changed:a4a87364-5abb-4580-9f56-b3db990fa486 for instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd on hv-cinder-83608 Jun 02 13:51:50.481888 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-ae493a6e-c3d7-41d3-97f1-955afbb28f03 req-82565ff6-9250-456d-af74-b6e98f006fb3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035028 Jun 02 13:51:50.482807 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 597/1218] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 13:51:50.489230 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e2f69f8d-a62e-45f2-8beb-a2e8eb5e4f4f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 13:51:50.580808 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e2f69f8d-a62e-45f2-8beb-a2e8eb5e4f4f tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 204 len: 0 microversion: 2.1 time: 0.135551 Jun 02 13:51:50.582014 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 622/1219] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:51:50 2022] DELETE /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 13:51:50.597889 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-86b15536-68f9-4b08-a6dc-69150e600c67 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:50.599054 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-86b15536-68f9-4b08-a6dc-69150e600c67 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:50.608742 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86b15536-68f9-4b08-a6dc-69150e600c67 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:50.609579 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86b15536-68f9-4b08-a6dc-69150e600c67 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:50.610614 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86b15536-68f9-4b08-a6dc-69150e600c67 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:50.611448 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86b15536-68f9-4b08-a6dc-69150e600c67 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:50.782852 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-86b15536-68f9-4b08-a6dc-69150e600c67 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:51:50.790709 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-86b15536-68f9-4b08-a6dc-69150e600c67 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1577 microversion: 2.1 time: 0.202988 Jun 02 13:51:50.791138 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 598/1220] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:51:50 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:51:51.808684 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-598fddc1-5b3f-4ca2-a913-67567b1d2f9b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:51.809390 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-598fddc1-5b3f-4ca2-a913-67567b1d2f9b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:51.816066 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-598fddc1-5b3f-4ca2-a913-67567b1d2f9b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:51.816549 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-598fddc1-5b3f-4ca2-a913-67567b1d2f9b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:51.817331 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-598fddc1-5b3f-4ca2-a913-67567b1d2f9b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:51.817766 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-598fddc1-5b3f-4ca2-a913-67567b1d2f9b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:52.041735 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-598fddc1-5b3f-4ca2-a913-67567b1d2f9b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:51:52.051247 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-598fddc1-5b3f-4ca2-a913-67567b1d2f9b tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1577 microversion: 2.1 time: 0.246758 Jun 02 13:51:52.051845 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 623/1221] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:51:51 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1577 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 13:51:52.728139 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-1031b89a-fd74-416b-9aa8-45582f74c3e2 req-65dcaecb-4511-4814-b4a0-f1d090b44afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd", "name": "network-vif-deleted", "tag": "a4a87364-5abb-4580-9f56-b3db990fa486"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 13:51:52.738544 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-1031b89a-fd74-416b-9aa8-45582f74c3e2 req-65dcaecb-4511-4814-b4a0-f1d090b44afa service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:52.738907 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-1031b89a-fd74-416b-9aa8-45582f74c3e2 req-65dcaecb-4511-4814-b4a0-f1d090b44afa service nova] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:52.752041 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-1031b89a-fd74-416b-9aa8-45582f74c3e2 req-65dcaecb-4511-4814-b4a0-f1d090b44afa service nova] Creating event network-vif-deleted:a4a87364-5abb-4580-9f56-b3db990fa486 for instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd on hv-cinder-83608 Jun 02 13:51:52.758418 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-1031b89a-fd74-416b-9aa8-45582f74c3e2 req-65dcaecb-4511-4814-b4a0-f1d090b44afa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038046 Jun 02 13:51:52.759212 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 599/1222] 10.222.0.32 () {64 vars in 1317 bytes} [Thu Jun 2 13:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 13:51:53.071580 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:53.073725 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:53.085130 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:53.085965 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:53.087667 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:53.088451 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:53.130005 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:53.130459 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:53.131522 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lazy-loading 'fault' on Instance uuid 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 13:51:53.181129 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64d281c3f8e447aaacb073ed0f8c7a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25b312790b9644bb8fbe30d2ab637db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 13:51:53.189101 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-eb13a472-ebbe-46f3-836f-8a206c675cd4 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 200 len: 1231 microversion: 2.1 time: 0.123765 Jun 02 13:51:53.189982 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 624/1223] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:51:53 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 1231 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 13:51:54.207786 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-33846e99-a444-4852-94ca-27edf8f5df16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:54.208513 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-33846e99-a444-4852-94ca-27edf8f5df16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:54.216166 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-33846e99-a444-4852-94ca-27edf8f5df16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:54.216643 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-33846e99-a444-4852-94ca-27edf8f5df16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:54.217411 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-33846e99-a444-4852-94ca-27edf8f5df16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:54.217843 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-33846e99-a444-4852-94ca-27edf8f5df16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:54.232233 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-33846e99-a444-4852-94ca-27edf8f5df16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] HTTP exception thrown: Instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd could not be found. Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-33846e99-a444-4852-94ca-27edf8f5df16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Request method failure captured: Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd HTTP/1.1 Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimL7XN73cDAOX8wYWVFYcJ5qVHtk63Hg1rbWJsFHaWRYxS_6fXuWQdS2-Uu_YLlymyoxD2LIyyvT--KN5t7B5jucN5o267ZeoWaDE8KY4DjnN4j1t2KzhGS9MqAh1JCUxRd01UTzlmYFugCPugNCvax4yhYT8UeWg2ym4Xnwq6BU3bZ0 Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 25b312790b9644bb8fbe30d2ab637db0 Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:51:54.233908 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/25b312790b9644bb8fbe30d2ab637db0"}]}] Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 25b312790b9644bb8fbe30d2ab637db0 Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-TestVolumeBootPattern-1167520146-project Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 64d281c3f8e447aaacb073ed0f8c7a35 Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestVolumeBootPattern-1167520146-project Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd could not be found. Jun 02 13:51:54.235716 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': '7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd'} Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd could not be found. Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:51:54.236947 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd could not be found. Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd could not be found. Jun 02 13:51:54.238586 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.240328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-33846e99-a444-4852-94ca-27edf8f5df16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Returning 404 to user: Instance 7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:51:54.240328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-33846e99-a444-4852-94ca-27edf8f5df16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd" status: 404 len: 111 microversion: 2.1 time: 0.031810 Jun 02 13:51:54.240328 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 600/1224] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:51:54 2022] GET /compute/v2.1/servers/7b9bb000-fea3-4d5a-b3a9-afa0ab819bbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:51:54.684001 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5a63ac7f-f747-45ac-ab6b-15cdedf78fd5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:54.684612 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5a63ac7f-f747-45ac-ab6b-15cdedf78fd5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:54.691739 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a63ac7f-f747-45ac-ab6b-15cdedf78fd5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:54.692381 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a63ac7f-f747-45ac-ab6b-15cdedf78fd5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:54.693162 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a63ac7f-f747-45ac-ab6b-15cdedf78fd5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:54.693883 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5a63ac7f-f747-45ac-ab6b-15cdedf78fd5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:54.708021 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-5a63ac7f-f747-45ac-ab6b-15cdedf78fd5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] HTTP exception thrown: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5a63ac7f-f747-45ac-ab6b-15cdedf78fd5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Request method failure captured: Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 HTTP/1.1 Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept: application/json Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Connection: close Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Length: 0 Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Content-Type: application/json Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Host: 10.222.0.32 Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABimL7XN73cDAOX8wYWVFYcJ5qVHtk63Hg1rbWJsFHaWRYxS_6fXuWQdS2-Uu_YLlymyoxD2LIyyvT--KN5t7B5jucN5o267ZeoWaDE8KY4DjnN4j1t2KzhGS9MqAh1JCUxRd01UTzlmYFugCPugNCvax4yhYT8UeWg2ym4Xnwq6BU3bZ0 Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Id: None Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Domain-Name: None Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Id: 25b312790b9644bb8fbe30d2ab637db0 Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Role: member,reader Jun 02 13:51:54.709884 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Roles: member,reader Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/25b312790b9644bb8fbe30d2ab637db0"}]}] Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 25b312790b9644bb8fbe30d2ab637db0 Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User: tempest-TestVolumeBootPattern-1167520146-project Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Id: 64d281c3f8e447aaacb073ed0f8c7a35 Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-TestVolumeBootPattern-1167520146-project Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: method: > Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: exception: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:51:54.711571 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: action_args: {'id': 'dbd3b9ba-53ce-42d2-a66b-a887d8011754'} Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:51:54.712733 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:51:54.714502 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.716908 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5a63ac7f-f747-45ac-ab6b-15cdedf78fd5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Returning 404 to user: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:51:54.716908 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5a63ac7f-f747-45ac-ab6b-15cdedf78fd5 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "DELETE /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 404 len: 111 microversion: 2.1 time: 0.031630 Jun 02 13:51:54.716908 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 625/1225] 10.222.0.32 () {58 vars in 1238 bytes} [Thu Jun 2 13:51:54 2022] DELETE /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:51:54.720377 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aee602bc-db65-4c96-9543-542fcba62ca1 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:54.720995 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aee602bc-db65-4c96-9543-542fcba62ca1 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] [instance: dbd3b9ba-53ce-42d2-a66b-a887d8011754] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 13:51:54.728507 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aee602bc-db65-4c96-9543-542fcba62ca1 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:54.728507 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aee602bc-db65-4c96-9543-542fcba62ca1 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:54.729946 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aee602bc-db65-4c96-9543-542fcba62ca1 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 13:51:54.729946 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aee602bc-db65-4c96-9543-542fcba62ca1 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Lock "309ea19d-aef7-4c6c-9f87-a5fdcea29505" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 13:51:54.744679 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-aee602bc-db65-4c96-9543-542fcba62ca1 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] HTTP exception thrown: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aee602bc-db65-4c96-9543-542fcba62ca1 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Request method failure captured: Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 HTTP/1.1 Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept: application/json Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Connection: close Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Length: 0 Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Content-Type: application/json Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Host: 10.222.0.32 Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABimL7XN73cDAOX8wYWVFYcJ5qVHtk63Hg1rbWJsFHaWRYxS_6fXuWQdS2-Uu_YLlymyoxD2LIyyvT--KN5t7B5jucN5o267ZeoWaDE8KY4DjnN4j1t2KzhGS9MqAh1JCUxRd01UTzlmYFugCPugNCvax4yhYT8UeWg2ym4Xnwq6BU3bZ0 Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Id: None Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Domain-Name: None Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Id: 25b312790b9644bb8fbe30d2ab637db0 Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Role: member,reader Jun 02 13:51:54.746266 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Roles: member,reader Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.32:8080", "publicURL": "http://10.222.0.32:8080/v1/AUTH_25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/25b312790b9644bb8fbe30d2ab637db0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/25b312790b9644bb8fbe30d2ab637db0"}]}] Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 25b312790b9644bb8fbe30d2ab637db0 Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestVolumeBootPattern-1167520146 Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User: tempest-TestVolumeBootPattern-1167520146-project Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Id: 64d281c3f8e447aaacb073ed0f8c7a35 Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestVolumeBootPattern-1167520146-project Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: method: > Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: exception: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:51:54.748226 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: action_args: {'id': 'dbd3b9ba-53ce-42d2-a66b-a887d8011754'} Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 13:51:54.749205 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. Jun 02 13:51:54.750517 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Jun 02 13:51:54.751687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aee602bc-db65-4c96-9543-542fcba62ca1 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Returning 404 to user: Instance dbd3b9ba-53ce-42d2-a66b-a887d8011754 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 13:51:54.751687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-aee602bc-db65-4c96-9543-542fcba62ca1 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754" status: 404 len: 111 microversion: 2.1 time: 0.031331 Jun 02 13:51:54.751687 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 601/1226] 10.222.0.32 () {58 vars in 1235 bytes} [Thu Jun 2 13:51:54 2022] GET /compute/v2.1/servers/dbd3b9ba-53ce-42d2-a66b-a887d8011754 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 13:51:56.077923 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b2ca26ad-3c6b-491e-a9ad-23744d020e16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] Calling method '.version_select at 0x7f861a2ca3a0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 13:51:56.103183 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b2ca26ad-3c6b-491e-a9ad-23744d020e16 tempest-TestVolumeBootPattern-1167520146 tempest-TestVolumeBootPattern-1167520146-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1204951225" status: 202 len: 0 microversion: 2.1 time: 0.029012 Jun 02 13:51:56.103921 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 626/1227] 10.222.0.32 () {58 vars in 1262 bytes} [Thu Jun 2 13:51:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1204951225 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 13:52:55.778905 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:52:55.779565 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Thu Jun 2 13:52:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:54:41.347657 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:54:41.348333 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Thu Jun 2 13:54:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:54:46.661006 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:54:46.661660 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Thu Jun 2 13:54:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:54:47.579470 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:54:47.580083 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Thu Jun 2 13:54:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:54:57.803545 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:54:57.804160 dv-cinder-836083-8-iscsi devstack@n-api.service[124123]: Thu Jun 2 13:54:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:55:07.132113 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:55:07.132584 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Thu Jun 2 13:55:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 13:56:15.787274 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 13:56:15.788743 dv-cinder-836083-8-iscsi devstack@n-api.service[124122]: Thu Jun 2 13:56:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!